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A PRELIMINARY  EVALUATION  OF  A DECISION  SUPPORT  COMPLEX  IN  SIMTOS 


BRIEF 


Requirement : 


To  evaluate  a decision  support  complex  deslgnc.d  to  help  a G3 
officer  In  acquiring  Information  and  making  decisions  within  the 
simulated  tactical  operations  system  (SIMTOS)  environment. 


Procedure : 


Ten  experienced  tactical  decision  makers  were  used  In  this 
Investigation.  Participants  acted  as  G3s  In  a SIMTOS  defensive 
scenario.  Typical  planning  and  combat  activities  were  Included. 
Five  participants  usee-  the  decision  support  complex  and  five  did 
not. 


Findings ; 


The  aided  group  used  significantly  more  of  the  available 
resources  than  did  the  unaided  group.  In  terms  of  friendly  and 
enemy  force  attrition  as  well  as  distance  surrendered  from  the 
forward  edge  of  battle,  the  aided  group  showed  a trend  toward 
superior  tactical  performance.  There  was,  however,  no  significant 
difference  between  the  two  groups  for  these  variables. 


Utilization  of  Findings: 


Introduction  of  automated  equipment  Into  a decision  system  does 
not  necessarily  produce  quicker  or  better  decisions.  The  man- 
computer  Interface  Is  critical  to  an  Information  processing  cycle 
In  which  data  proliferate. 


Even  though  the  present  research  on  the  decision  support  complex 
was  preliminary  and  the  number  of  participants  small,  the  trend 
Indicated  that  the  concept  of  a decision  support  complex  Is  sound. 


Further  research  In  this  area  with  subsequent  Implementation  In 
an  automated  tactical  operations  center  will  contribute  to  an  effi- 
cient military  decision  system.  In  this  regard,  ARI  Is  continuing 
to  utilize  the  decision  support  complex  concept  in  further  studies 
of  tactical  decision  making. 
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ABSTRACT 
Volume  3 

A Preliminary  Evaluation 
of  a 

Decision  Support  Complex  In  SIMTOS 


i-.h 


A preliminary  evaluation  of  an  "estimate  of  the  situation"  aid  and  a "resource 
allocation"  aid  in  SIMTOS  was  conducted.  Two  groups  were  compared.  One  group 
(the  aided)  received  the  "estimate  of  the  situation"  in  both  the  planning 
and  combat  sessions.  The  other  group  (the  unaided)  did  not  receive  the  esti- 
mate aids.  The  "resource  allocation"  aid  was  available  to  both  groups  during 
combat.  Descriptive  techniques  were  used  to  analyze  the  data  from  the  small 
sample  (N  « 10) . The  estimate  aid  was  not  used  during  planning  due  to  its 
failure  to  meet  the  requirements  of  a successful  man/computer  dialog.  There- 
fore, little  difference  was  found  between  the  aided  and  the  unaided  groups 
during  planning.  For  combat,  the  estimate  aid  was  most  effective  early  in  the 
task  because  It  enabled  the  aided  group  to  utilize  their  resources  more  effi- 
ciently and  monitor  the  course  of  play  more  efficiently.  The  "resource  alloc- 
ation" aid  enabled  both  groups  to  achieve  some  success  during  the  combat 
play. 
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DEVELOPMENT  AND  APPLICATION  OF  A DECISION  AID  FOR  TACTICAL  CONTROL  OF 
BATTT.EFIELD  OPERATIONS 


Section  1 Introduction 

3.1.1  Volume  1 Overview 

The  initial  volume  of  this  report  outlined  a conceptual  structure  for 
decision  support  in  tactical  information  processing  systems.  The  con- 
ceptual s*-ructure  was  based  on  five  variables:  decision  style,  decision 

situation,  information,  mode  of  presentation  and  human/computer  dialog. 
Each  of  these  five  variables  serves  both  as  an  area  of  scientific  in- 
vestigation and  a set  of  system  specifications  for  decision  support 
systems.  In  Volume  1 the  variables  were  treated  as  both.  The  concep- 
tual structure  served  as  the  organizing  entity  by  which  the  decision 
aiding  literature  was  reviewed  and  several  "aiding  themes"  identified. 
These  variables  also  helped  generate  specific  criteria  or  specifications 
for  decision  support  systems, 

3.1.2  Volume  2 Overview 


In  Voliame  2 the  process  by  which  the  "aiding  themes"  were  adapted  to 
the  SIMTOS  context  was  documented.  The  underlying  generalization  which 


3.1.2  Volume  2 Overview  2. 

appeared  throughout  the  work  was  the  concept  of  the  decision  support 
system. 

Two  tasks  were  key  to  this  Integration  phase  of  the  research  program. 

The  first  was  the  development  of  a technique  to  measure  decision  style 
to  determine  the  type  of  the  estimate  aid  In  a manner  consistent  with 
the  overall  SIMTOS  context.  The  second  task  Involved  the  development 
of  an  Integration  technique  for  the  decision  support  complex  (as  re- 
flected In  software  specifications)  which  resulted  In  changes  to  the 
existing  SIMTOS  software.  The  Integration  technique  was  also  required 
to  Introduce  the  decision  support  complex  into  SIMTOS  in  a manner  con- 
sistent with  the  requirements  of  meaningful  human/computer  dialog. 

3.1.3  Volume  3 Organization 

This  volume  details  a preliminary  evaluation  of  the  effectiveness  of 
a decision  support  complex  in  the  SIMTOS  environment.  Section  2 con- 
tains a statement  of  the  problem  as  well  as  the  rationale  for  the  ap- 
proach to  the  development  of  the  decision  support  complex.  The  specific 
form  of  the  decision  support  complex  in  SIMTOS  and  the  methodology  for 
Its  evaluation  are  also  detailed  in  Section  2.  Section  3 details  the 
experimental  methodology  and  procedure.  Section  4 describes  the  results 
of  the  data  analysis.  A discussion  of  these  results  is  contained  In 


- 


3.1.3  Volume  3 Organization 


3. 


Section  5',  along  with  conclusions  concerning  the  refinement  and  extension 
of  the  decision  support  complex. 


m 
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Section  2 Evaluation  Background 
3.2.1  Developmental  Setting 

The  Army  Research  Institute  (ART)  Is  Investigating  decision  making  be- 
havior with  the  ultimate  goal  of  Improving  the  design  of  tactical  com- 
mand and  control  systems.  The  Army  Research  Institute's  vehicle  for 
command  and  control  research  is  SIMTOS  (Simulated  Tactical  Operations 
System) . SIMTOS  consists  of  an  automated  data  base  which  can  be  ac- 
cessed by  the  user  to  obtain  Information  normally  available  from  an 
Army  division  staff. ^ 


Thlf:  report  describes  a research  effort  to  evaluate  a decision  support 
complex  that  will  assist  a 6-3  officer  In  his  Information  acquisition 
^.nd  decision  making  activities  within  the  SIMTOS  environment. 

3.2.2  Rationale  for  the  Development  of  the  Decision  Support  Complex 

Much  has  been  written  concerning  the  nature  and  form  of  human  decision 
making,  particularly  In  terms  of  a tactical  environment.  However,  If  a 


^ See  Krumm,  Rowe,  Torpey,  and  Ringel  (1S70)  for  a detailed  discussion 
of  the  genesis  and  Implementation  of  this  system. 
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single  generalization  can  be  made  about  this  literature,  it  is  that 
the  decision  making  process  is  not  fully  understood  (Mack,  1971;  Okrina, 
1970).  Further,  what  is  understood  has  been  gathered  in  studies  more 
elementary  than  the  operational  tactical  scenario  (Freedy,  Welsbrod, 

May,  Schwartz,  and  Wettman,  1973).  The  lesson  to  be  gleaned  from  the 
technical  literature  is  that  any  attempt  to  "aid"  the  decision  maker 
in  realistic  tactical  environments  cannot  be  totally  dependent  upon 
existing  models  of  human  decision  making.  The  present  empirical  study 
of  tactical  decision  making  is  generally  model  independent  since  ob- 
servations of  decision  making  are  done  "in  vivo" — as  they  occur  during 
the  course  of  an  actual  tactical  problem  as  with  the  SIMTOS  defensive 
scenario. 

Two  major  methodologies  have  emerged  to  ail  the  tactical  decision  making 
process.  One  is  mathematically  based;  the  other  sltuatlonally  based. 

In  the  mathematically  based  methodology,  decision  aiding  is  defined  as 
the  allocation  of  decision  functions  between  man  and  machine  (computer) 
in  a way  which  optimizes  their  respective  strengths  (Freedy,  Weisbrod, 
May,  Schwartz,  and  Wettman,  1973).  The  key  to  this  methodology  is  to 
assist  the  decision  maker  in  optimizing  his  performance  relative  to 
some  external  criterion.  While  the  application  of  mathematically  based 
decision  aiding  techniques  has  led  to  much  research,  the  ccntribution 
of  these  techniques  to  tactical  operations  systems  is  unclear.  These 
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procedures  suffer  from  problems  relating  to  the  structuring  of  hypothese?, 
estimation  of  priors,  untangling  of  source  reliability,  and  robustness 
(Schum,  Southard,  and  Wombolt,  1969). 

If  decision  making  is  defined  as  a process  by  which  the  tactical  officer 
organizes  and  Interprets  the  information  in  his  environment,  another 
sltuatlonally  based  decision  aiding  methodology  becomes  apparent. 

This  approach  considers  decision  making  and  decision  aiding  in  specific 
contexts,  such  as  tactical  scenarios.  In  this  case,  decision  making 
is  not  defined  as  a mathematical  function,  but  as  the  actual  procedures 
used  by  decision  makers.  These  two  methodologies  should  not,  however, 
conflict  with  each  other  but  work  in  concert  to  provide  techniques  for 
decision  aiding  in  human/ computer  systems. 

A crucial  task  of  decision  aiding  in  an  automated  tactical  information 
system  is  to  provide  an  effective  interface  between  the  tactical  decision 
maker  and  his  computer  system.  In  a complex  system,  such  as  SIMTOS, 
there  is  no  situation  wherein,  if  the  decision  making  process  were 
aided,  it  would  provide  a total,  efficient  interface.  Therefore,  a 
number  of  decision  aiding  techniques  of  mixed  methodologies  directed  at 
different  levels  of  the  decision  making  process  and  system  operation 
are  required.  This  complex  of  decision  aids  is  called  a decision 
support  system  (Meador  and  Ness,  1973;  Morton,  1973). 
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A taxonomy  of  the  decision  aids  within  the  domain  of  the  situational 
methodology  is  depicted  in  Figure  3-1.  Shown  are  decision  aiding  tech- 
niques that  are  adaptive  (responsive  to  differences  in  decision  style) 
and  normative  (designed  to  fit  some  general  user — the  "average"  person) . 
Within  these  techniques,  four  types  of  decision  aids  can  be  identified: 
organizational,  performance,  task  specific,  and  process  aids.^  Organi- 
zational aids  assist  the  decision  maker  in  structuring  his  information 
into  a systematic  form  (e.g.,  Kepner  and  Tregoe,  1965).  In  contrast, 
performance  oriented  decision  aids  assist  the  decision  maker  in  using 
information  in  an  optimal  manner  so  that  the  decisions  will  be  of  better 
quality,  considered  in  terms  of  some  objective  performance  criterion 
(e.g.,  Brewin's  1964).  A task  specific  decision  aid  focuses  upon  par- 
ticularly complex  or  difficult  task  components,  helping  the  decision 
maker  cope  with  that  aspect  of  his  activities.  Finally,  process  oriented 
aids  are  designed  to  help  the  tactician  with  his  cognitive  information 
processing  activities,  as  these  are  presumed  constant  regardless  of 
task  specifics. 


Using  this  structure  as  a guide,  the  decision  aiding  literature  was 
reviewed.  Seventeen  aiding  concepts  were  identified  as  potentially 


^ The  rationale  for  this  decision  aiding  taxonomy  has  been  extensively 
discussed  in  Volume  1,  Section  1.2.3  of  this  report. 
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SITUATIONAL  METHODOLOGIES 


TECHNIQUES 


ADAPTIVE 


NORMATIVE 


ORGANIZATION  AIDS 
PERFORMANCE  AIDS 
TASK  SPECIFIC  AIDS 
PROCESS  AIDS 


Figure  3-1,  Taxonomy  of  Decision  Aids 

Within  Situational  Methodologies 


relevant  for  the  SIMTOS  decision  support  complex.^  Three  recurrent 


aiding  themes  were  Isolated.  They  are: 


^ These  17  aiding  concepts  were  believed  to  be  exemplary  of  the  liter- 
ature in  accordance  with  the  types  of  aids  listed  above.  A detailed 
discussion  of  this  is  contained  in  Volume  1,  Section  1.2.4  of  this 
report. 
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• Estimate  of  the  situation  aiding 

• Resource  allocation  aiding 

• Contingency  planning  aiding 

Estimate  of  the  situation  aiding  provides  the  decision  maker  with  the 
relevant  core  Information  necessary  to  structure  and  interpret  the  prob- 
lems in  a decision  situation.  Since  information  requirements  seem  to  be 
highly  individualistic,  "estimate"  aids  might  be  adaptive  in  nature. 
Resource  allocation  aiding  provides  the  decision  maker  with  the  informa- 
tion and  communicative  authority  to  disperse  resources  in  some  systematic 
and  optimal  manner  for  a particular  task  or  tasks.  Contingency  planning 
aiding  provides  the  decision  maker  with  the  capability  to  play  "what  if" 
and  to  thereby  study  the  consequences  .of  alternative  actions. 

The  decision  support  complex  evaluated  in  this  study  reflects  the  first 
two  of  these  themes.  To  implement  the  complex  in  SIMTOS,  the  specifica- 
tions were  adapted  to  the  specifics  of  the  system  and  its  operating  en- 
vironment. The  aids  and  their  Implementation  are  discussed  briefly  in 
the  following  section.** 


**  The  details  of  the  implementation  of  the  complex  into  SIMTOS  are 
contained  in  Voliane  2 of  this  report. 
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The  Task 


The  scenario  for  this  study  consisted  of  a tactical  defensive  exercise 
for  an  operations  officer  (G-3)  at  the  division  level.  The  exercise  was 
divided  into  two  discrete  sessions — planning  and  combat. 


The  planning  session  required  the  G-3  to  construct  plans  for  the  20th 
Mechanized  Division  to  defend  a sector  of  the  Hof  Gap  in  Germany.  While 
the  general  situation  was  described  in  the  Operations  Orders,  specific 
details  on  personnel,  intelligence  and  other  variables  were  contained  in 
the  static  SIMTOS  data  base.  This  data  base  consisted  of  ten  categories 
of  information,  normally  available  to  the  entire  staff  of  an  Army  division. 
Each  of  these  ten  categories  was  repeatedly  subdivided  into  more  detailed 
levels  of  information,  yielding  a structure  that  goes  from  very  general 
to  very  detailed  information  (see  Appendix  A,  Exhibit  4). 


For  the  combat  session,  the  task  was  to  execute  a defense  against  an 
invading  army  in  the  same  sector  of  the  Hof  Gap  again  acting  as  the  G-3. 
During  combat  the  data  base  was  dynamic  in  that  it  changed  as  a function 
of  events  (e.g.,  the  incorporation  of  inputs  from  the  G-3  and  the  pre- 
programmed directives  concerning  the  enemy  forces). 
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The  Support  System  - Planning 


The  decision  support  system  Implemented  into  SIMTOS  for  this  preliminary 


evaluation  consisted,  as  Indicated  previously,  of  the  concepts  of  situ- 
ation estimate  and  resource  allocation  aiding.  The  G-3's  task  in  planning 
was  to  assimilate  the  key  Information  contained  in  the  data  base  as  a 
recommended  course  of  action,  concept  of  maneuver,  and  mission  statements 
for  the  20th  Mech  Division. 


Based  upon  information  requirements  for  performance  of  the  G-3  officer’s 
task,  as  soeclfied  in  the  Staff  Officers  Field  Manual  (FMlOl-5) , an 
estimate  of  the  situation  aid  was  tailored  to  the  SIMTOS  planning  session. 
Earlier  studies  of  G-3  information  requirements  (Strub,  1971)  provided 
guidance  to  information  detail  vis-a-vis  SIMTOS. 


The  estimate  aid  consisted  of  selected  Information  frames  which  could 
be  directly  accessed  without  using  the  general  index  to  the  data  base. 
These  frames  were  hypothesized  to  contain  key  pieces  of  information  re- 
garding the  situation  and  thus  provided  the  G-3  with  an  overview  or 
"estimate"  of  what  was  contained  in  the  data  base.  The  G-3  had  the 
option  to  continue  in  the  data  base  from  the  point  at  which  a file  frame 
was  located.  Therefore,  the  aid  also  served  as  an  index  to  the  data 
base. 


1 


-1 
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Large  individual  differences  exist  in  the  information  seeking,  informa- 
tion processing,  and  action  selection  behaviors  of  tactical  decision 
makers.  The  estimate  of  the  situation  aid  was  therefore  made  adaptive 
by  varying  it  to  match  four  possible  types  of  decision  styles  determined 
by  the  Decision  Style  Measurement  Instrument  (DSMI) . ^ 

The  Support  System  - Combat 

During  a combat  phase,  much  of  a G-3*s  activities  consist  of  monitoring 
and  adjusting  the  defensive  operational  plans.  In  SIMTOS,  this  role 
takes  the  form  of  sensing  the  changing  situation  through  changes  in  the 
data  base.  The  SIMTOS  system  provides  a method  for  keeping  track  of 
these  changes  through  Standing  Requests  for  Information  (SRIs) . If  an 
SRI  is  set  up  on  a piece  of  Information,  the  G-3  is  notified  if  any 
change  occurs  in  that  piece  of  information.  For  example,  if  an  SRI  is 
established  on  a unit  location  and  subsequently  that  unit  location 
changes,  the  system  user  is  notified.  Thus,  the  purpose  of  the  SRI  is 
to  aid  in  the  detection  of  key  changes  in  the  combat  environment. 


An  estimate  of  the  situation  aid  was  again  structured  via  the  SRI  func- 
tion for  incorporation  into  the  SIMTOS  combat  session.  A pre-selected 


® A short  discussion  of  the  Instrument  and  G-3  assignment  to  groups  is 
given  in  the  next  section.  The  full  Instrument  and  its  derivation 
is  contained  in  Volume  2 of  this  report. 
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SRI  list  was  developed  for  the  G-3.  This  list  contained  pieces  of 
Information  which  highlighted  the  differences  between  the  planning  and 
combat  environments.  The  list  also  contained  intelligence  information 
in  the  form  of  unit  spot  reports.  Although  it  would  have  been  desirable 
to  tailor  this  aid  to  the  individual  G-3,  time  and  resources  precluded 
this.  The  developed  list  was  therefore  standardized  and  was,  hence,  a 
normative  aid  form. 

In  addition,  a resource  allocation  aid  was  developed  for  the  SEiTOS  com- 
bat session.  The  aiding  concept  optimized  weapon  usage  by  allowing  the 
G-3  to  select  the  weapon(s)  to  be  used  against  a specific  target.  By 
indicating  the  coordinates  of  a map  location,  the  G-3  received  a display 
containing  units,  their  associated  weapon  type,  and  standard  volleys 
or  sorties  that  were  within  striking  range  of  that  location.  The  G-3 
could  then  designate  which,  if  any,  of  the  units  and  how  much  of  their 
resources  he  wished  to  commit  to  firing  at  the  specified  location.  This 
aid  was  also  normative  and  could  be  classified  as  a task  aid  according 
to  our  taxonomy.  Further,  this  aid  was  embedded  in  the  system  software. 
Pilot  sessions  had  shown  that  the  combat  task  was  almost  unworkable  d‘ie 
to  the  complexities  of  the  non-G-3  type  tasks  required  and  the  speed 
with  which  the  problem  developed.  It  was  decided  that  without  the  re- 
source allocation  aid  available  to  all  G-3's,  any  differences  in  per- 
formance due  to  the  estimate  aids  would  be  overshadowed. 
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Independent  Variables 

To  clarify,  the  aids  discussed  in  the  previous  section  were  incorporate 
into  SIMTOS  as  follows: 

• Planning  Session 
1)  adaptive 

• "estimate  of  situation" 

• Combat  Session: 

1)  normative 

• "estimate  of  situation" 

• "resource  allocation" 

For  the  purpose  of  making  a preliminary  evaluation  of  the  decision  support 
complex,  two  groups  were  established.  One  group  (aided)  had  access  to 
the  "estimate  of  the  situation"  aids  and  the  other  group  (unaided)  did 
not.  As  indicated  above,  during  the  combat  session,  both  groups  could 
access  the  resource  allocation  aid. 

To  determine  the  form  of  the  aid  for  the  planning  session  and  for  com- 
parison purposes,  each  participant  took  the  Decision  Style  Measurement 
Instrument  (DSMI)  prior  to  the  planning  session.  While,  in  theory,  a 
large  number  of  decision  styles  exist,  in  practice  it  has  been  found 
that  groups  of  decision  makers  cluster  around  a very  few  dimensions  of 
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style  which  uses  three  dimensions  of  information  processing  behavior 
to  classify  eight  types  of  decision  styles  (Figure  3-2).  The  DSMI  was, 
therefore,  developed  as  a methodology  of  assessment  of  these  eight 
decision  styles.® 


ACTIVE 


Figure  3-2.  Dimensions  of  Decision  Style 


The  forms  of  the  estimate  of  the  situation  aid  consisted  of  four  lists 
of  frames  from  the  planning  data  base.  These  corresponded  to  tv’o  of 
the  three  dimensions  of  decision  style  as  follows: 


A full  treatment  of  the  DSMI  rationale  is  contained  in  Volume  1 of 
this  report. 
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• Abstract-Logical 


• Abstract-Intuitive 


• Concrete-Logical 

• Concrete- Intuitive 

The  abstract-concrete  distinction  was  accounted  for  by  specific  list 
content;  the  logical- intuitive  distinction  by  order  within  list  content. 


Depending  on  his  decision  style  as  measured  by  the  DSMI,  an  aided  G-3 
had  available  one  of  the  above  four  lists  during  planning.  The  active- 
passivf  dimension  was  accounted  for  in  the  instructions  for  use  of  the 
estimates.  The  active  G-3’s  were  instructed  only  in  the  mechanics  of 
accessing  the  estimate.  The  passive  G-3’s  were  instructed  in  the 
mechanics  but  were  also  instructed  to  access  each  of  the  frames  con- 
tained in  the  list  before  starting  the  task.  The  rationale  used  was 
that  the  more  passive  users  would  require  prompting  to  use  the  aid. 
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Dependent  Variables 


Two  types  of  measures  were  used  to  evaluate  performance  on  the  tasks: 
tactical  performance  measures  and  information  processing  measures. 


Each  G-3,  during  planning,  wrote  out  his  plans  for  a defensive  operation. 
The  elements  on  which  the  G-3*s  were  assessed  were:  assignment  of 

maneuver  units  to  echelon;  concept  of  maneuver,  and  mission  statements. 
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These  plans  were  scored  using  a procedure  derived  from  Coiranand  and 
General  Staff  College  norms  by  Bunker-Ramo  (1973).  For  planning,  the 
tactical  performance  measure  was,  thus,  the  scores  on  these  written 
plans. 

Adaptations  of  five  measures  "determined  to  be  of  significant  importance 
in  assessing  combat  performance  during  defensive  operations"  (Bunker- 
Ramo,  1973)  were  used  for  evaluation  of  tactical  combat  performance. 

They  were; 

• friendly  force  attrition 

• enemy  force  attrition 

• distance  surrendered 

• friendly  force  weapon  expenditure 

• friendly  force  air  strikes  expended 

The  information  processing  measures  were  used  for  evaluating  system 
usage.  The  aid  was  linked  to  the  behaviors  reflected  in  these  measures. 
For  the  planning  phase,  the  following  measures  were  used; 

• sources  sought 

• action  ratio 

• error  ratio 

• redundancy  ratio 

• information  acquisition  efficiency 

• aid  usage 
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For  combat,  all  of  the  above  Information  processing  measures  were  used 
plus  the  following  measures  specific  to  combat: 

• resource  allocation 

- usage  efficiency 

- firing  time 

• SRI  usage 

• estimate  aid  usage 


A complete  discussion  of  both  the  terminal  performance  measures  and  the 
information  processing  measures  and  their  derivation  from  the  data  is 
contained  in  the  results  section  of  this  report.  (See  table  ~ Appendix  C. 


Hypotheses 

In  accordance  with  the  variables  discussed  in  the  preceding  sections, 
the  following  specific  hypotheses  were  generated: 

1.  The  aided  group  would  score  higher  on  the  tactical  performance 
measure  for  the  planning  session  than  the  unaided  group. 

2.  The  aided  group  would  use  the  system  more  efficiently  according 
to  the  Information  processing  measures  than  the  unaided  group 
during  planning. 

3.  The  aided  group  would  score  higher  on  the  tactical  performancce 
measures  for  the  combat  session  than  the  unaided  group. 

4.  The  aided  group  would  use  the  system  more  efficiently  according 
to  the  information  processing  measures  than  the  unaided  group 
during  the  combat  session. 


5.  A high  correlation  would  exist  between  system  usage  efficiency 
and  the  tactical  performance  measures. 
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Section  3 Method 
3.3.1  Consultants 

The  U.  S.  Army  Military  Personnel  Division  supplied  the  Army  Research 
Institute  with  a list  of  officers  assigned  to  duty  in  the  Washington, 

D.  C.,  area,  who  met  the  following  minimum  requirements: 

• Education:  Graduation  from  the  Command  and  General  Staff  College 

• Experience : 

1.  Battalion  commander  or  higher 
or 

2.  S-3  of  a brigade 
or 

3.  G-3  of  a division 
or 

4.  Member  of  a division  level  staff 

'Ten  officers  from  this  list  volunteered  to  act  as  participants  in  the 
decision  support  complex  evaluation.^ 


^ Background  data  on  each  of  the  consultants  is  summarized  on  page  42 
of  the  Results  section. 
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3.3.2  Experimental  System 


The  Army  Research  Institute’s  SIMTOS  Laboratory  was  used  to  conduct  the 
evaluation.  The  equipment  and  software  comprising  SIMTOS  were  set  up 
and  operated  as  previously  described  (Bunker-Ramo , 1973)  except  as  noted 
below.® 


Two  participant  work  stations  were  set  up:  one  for  the  aided  and  one 

for  the  unaided  group.  Each  station  contained  a CDC-211  CRT  display,  an 
IBM  llneprinter,  a work  table,  a 24-hour  clock  set  to  run  three  times 
faster  than  real  time,  a 25000:1  scale  tactical  map  of  the  Hof  Gap  area, 
and  unit  identification  stickers  for  all  of  the  friendly  and  enemy  forces. 
The  aided  work  station  had  an  additional  CDC-211  display  to  present  the 
estimate  aid.  A separate  experimenter  station  contained  a CDC-211  CRT 
from  which  activities  at  the  work  station  could  be  monitored  and  controlled 
remotely. 


3.3.3  Procedure 


The  G-3’s  participated  at  the  rate  of  one  per  day  for  approximately 

nine  hours.  The  scheduled  procedure  for  the  task  is  depicted  in  Table  3-1. 


® The  hardware  and  software  modifications  pursuant  to  the  decision 
support  complex  are  discussed  in  detail  in  Volume  2 of  this  report. 
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Before  beginning  the  planning  session,  the  G>3's  were  taken  to  a work 
station  and  given  the  following  Introduction  and  instructions  for  their 
participation  In  the  Decision  Style  Measurement  Instrument  (DSMI) 
interview: 

"The  Army  Research  Institute,  an  activity  of  the  Army  Chief 
of  Research  and  Development,  Is  studying  decision  making  be- 
havior with  the  ultimate  goal  of  improving  the  design  of 
tactical  command  and  control  systems.  They  are  concerned 
with  military  information  processing  and  simulation,  problem 
solving,  and  decision  making  behavior.  SIMTOS  (Simulated 
Tactical  Operations  System)  was  designed  by  the  Army  Research 
Institute  to  be  used  as  a tool  for  conducting  their  research. 
SIMTOS  consists  of  an  automated  data  base  which  must  be 
accessed  by  the  particular  user  (in  your  case,  a G-3  officer) 
to  obtain  information  normally  available  from  the  division 
staff  officers. 

The  Life  Sciences  Group  of  Honeywell,  Inc.  is  developing  and 
evaluating  a decision  aiding  complex  to  assist  the  G-3  offi- 
cer in  his  information  acquisition  and  decision  making  acti- 
vities within  this  SIMTOS  environment.  The  overall  objective 
of  this  research  is  to  develop  principles  of  decision-aiding 
applicable  to  military  tactical  command  and  control  systems 
in  general. 

An  integral  part  of  this  research  is  concerned  with  a command- 
er's information  processing  characteristics  or  "decision 
style."  Therefore,  we  will  conduct  an  interview  consisting 
of  a set  of  scenarios  illustrating  different  decision  situa- 
tions. You  will  be  given  sets  of  alternatives  between  which 
you  must  choose,  based  on  your  perception  of  the  role  de- 
picted in  the  scenario.  These  alternatives  are  not  meant  to 
be  mutually  exclusive;  however,  you  must  select  the  one 
closest  to  your  own  viewpoint.  I want  to  emphasize  that  there 
are  no  right  or  wrong  answers  to  these  questions.  Remember, 
answer  as  if  you  are  in  the  role  described." 


i 


3.3.3  Procedure 


23. 


The  introduction,  Instructions,  and  the  administration  of  the  DSMI  inter- 
view required  about  one  and  one  half  hours.  After  the  interview,  the  G-3 
was  given  the  following  items  to  read:^ 

• Tactical  Situation  Summary  (Exhibit  1) 

• OPORD  63  (Exhibit  2) 

• Planning  Activities  Overview  (Exhibit  3) 

The  experimenter  returned  to  his  work  station  to  score  the  DSMI  and 
set  up  the  experimental  environment  according  to  the  procedures 
described  below: 


Turn  tele^-pe  off  (switch  "F"  for  aided,  switch  "M" 
for  unaided  away  from  ”computer") 


• CRT  operation: 


1.  "LINE  SKIP"  cursor  to  "INITIAL  START" 

2.  Type  "X"  and  press  "SEND" 

3.  Press  "SEND" 

4.  Type  "P"  and  press  "SEND" 

5.  Type  "6"1°  and  "LINE  SKIP"  to  "LOGIN" 

6.  Type  "X"  and  "SLEW"  to  "SCENARIO  (D  or  0)" 

7.  Type  "D"  and  "SLEW"  to  "SUBJECT  NUMBER" 

8.  Type  three  digit  niunber  identifying  G-3  and  press  "SEND" 

9.  Type  "6"  and  "LINE  SKIP"  to  "START  PLANNING  SESSION" 

10.  Type  "X"  and  press  "SEND" 

(For  unaided  skip  to  G-3’s  recording  message  procedure) 

11.  Type  "6"  and  "LINE  SKIP"  to  "CHANGE  OPERATING  ENVIRONMENT" 

12.  Type  "X"  and  "SEND" 


^ All  instructions  and  response  sheets  are  Identified  with  exhibit 
numbers  and  are  contained  in  Appendix  A. 
por  unaiu  id  G-3*s,  substitute  "5"  for  "6"  in  all  cases. 
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13.  "LINE  SKIP"  to  LOAD  SRI  SET  NUMBER  (00-05)" 

14.  Type  two  digit  file  number  according  to  measured  decision 
style  and  "LINE  SKIP"  to  "MODIFIED  PLANNING  SESSION  (YES- 
NO)" 

15.  Type  "YES"  and  "SEND" 

• Procedure  for  recording  messages: 

1.  Type  "6"  and  "LINE  SKIP"  to  "RECORD  MESSAGE" 

2.  Type  "X"  and  "SLEW"  to  the  row  of  dots 

3.  Type  message  (max.  11  characters)  and  "SEND" 

• Record  the  following  messages: 

1.  "START  PLAN" 

2.  Name  of  G-3 

3.  G-3  code  number 

4.  Time  of  day 

5.  "STRT  INSTRCT" 

The  experimenter  then  went  to  the  G-3’s  work  station  and  read  the  planning 
instructions: 

"To  complete  your  planning  activities,  you  will  have  access 
to  an  automated  tactical  data  system  (SIMTOS) . This  system 
provides  the  information  currently  available  from  the  division 
staff. 

The  information  contained  in  the  data  base  is  organized  under 
the  following  major  categories  as  contained  on  the  general 
index  frame  on  the  CRT: 

1 . G-1  Personnel 

2.  G-2  Intelligence 

3.  G-3  Operations 

4.  G-4  Logistics 

5.  G-5  Civil  Affairs 

6.  Fire  Support  Element 

7.  Chemical,  Biological,  Radiological 

8.  Engineer 

9.  Signal 

10.  Transportation 
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You  can  call  up  the  desired  tactical  Information  using  the 

CRT,  according  to  the  procedure  I will  now  demonstrate  to 

you." 

The  G-3  was  given  the  data  base  chart  (Exhibit  4)  and  instructed  to: 

• Start  from  the  G-3  category  and  step  all  the  way  dovm  to 
the  platoon  level  using  "number"  alternatives. 

• Use  "B"  option  key  to  return  to  battalion  level  and  explain 
that  this  is  the  operating  level  for  today's  problem. 

• At  the  battalion  level,  access  the  "letter"  options  (re- 
member to  tell  him  that  it  is  possible  at  this  level  to 
jump  to  the  next  letter  without  moving  up  a level) . 

• Use  "A"  option  to  go  to  the  GENERAL  INDEX 


Aided  G-3’s  were  given  the  following  additional  instructions: 

"Displayed  Information  on  this  adjacent  CRT  is  to  assist 
you  in  your  planning  activities.  These  are  data  base  frame 
titles.  To  obtain  information,  you  must  access  the  frames 
associated  with  these  titles,  according  to  a procedure  I now 
will  demonstrate  to  you.  The  Information  contained  on  the 
frames  was  selected  and  arranged  in  accordance  with  your 
specific  decision  style.  This  information  is  designed  to 
be  an  overview  of  the  situation  and  also  an  index  to  the 
data  base.. 

In  the  lower  right  hand  corner  of  the  data  base  CRT  are 
three  options  which  pertain  to  the  aided  CRT  and  which  will 
be  available  to  you  at  all  times.  The  "U"  option  will  move 
the  cursor  up  the  list  of  frame  titles  and  the  "V"  option 
will  move  the  cursor  down.  You  thus  can  position  the  cursor 
in  front  of  any  of  the  frame  titles.  If  you  wish  to  see 
the  frame  with  that  title,  simply  use  the  "W"  option.  The 
frame  will  appear  on  the  data  base  CRT,  You  are  now  in  the 
data  base  at  the  location  of  this  frame  and  have  all  the 
displayed  lower  frame  options  available. 

Due  to  CRT  space  limitations,  the  frame  titles  are  contained 
on  two  pages.  If  you  move  the  cursor  off  the  top  or  bottom 
of  the  list,  the  other  page  of  titles  will  be  displayed." 
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The  work  station  contents  were  then  explained  Including: 

• Maps 

• Wall  displays  (3:1  clock,  unit  stickers) 

• Work  table  and  contents  (telephone,  paper,  grease  pencils,  etc.) 


After  the  Planning  Activities.  Overview  (Exhibit  3)  was  reviewed,  the 
experimenter  set  the  3:1  clock  to  2100  and  gave  the  G-3  the  Commander’s 
Guidance  (Exhibit  5)  and  Instructions  and  Response  Sheet  1 (Exhibit  6) . 
The  experimenter  returned  to  his  station  and  started  Phase  1 by  start- 
ing the  3:1  clock  and  Inputting  the  following  messages  to  the  computer: 

• "ENDINSTRUCT" 

• Time 

• "STRT  PHASE  1” 

• "CLOCK  STRT" 

When  one  hour's  time  had  elapsed,  the  3:1  clock  was  stopped,  and  the 
following  messages  were  Input  to  the  computer  by  the  experimenter: 

• "END  PHASE  1" 

• "CLOCK  STOP" 

• Time 

The  experimenter  then  collected  Response  Sheet  1 from  the  G-3  and  gave 
him  the  Instructions  and  Response  Sheet  2 (Exhibit  7)  and  the  Instruc- 
tions and  Response  Sheet  3 (Exhibit  8} . The  experimenter  returned  to 
his  work  station,  started  the  3:1  clock  and  Input  the  following  messages 
to  start  Phase  2: 


• "STRT  PHASE  2" 

• "CLOCK  START" 

• Time 

After  one  hour,  the  experimenter  stopped  the  3:1  clock  and  Input  the 
end  messages  and  Instructions  to  the  computer: 

• "END  PHASE  2" 

• "CLOCK  STOP" 
c Time 

• Type  "6"  and  "LINE  SKIP"  to  "LOG  OUT" 

• Type  "X"  and  press  "SEND" 

Response  Sheets  2 and  3 were  then  collected  and  the  G-3  was  instructed  to 

prepare  an  SRI  list  as  follows: 

"An  SRI  (Standing  Request  for  Information)  is  set  up  to 
notify  you  when  changes  in  a particular  piece  of  information 
occur,  such  as  the  location  of  a unit.  During  combat,  you 
will  have  a maximum  list  of  30  SRIs.  As  specifically  as 
possible,  for  the  next  15  minutes,  please  write  down  the 
information  you  would  like  to  have  in  such  a list." 

After  15  minutes,  the  G-3  was  dismissed  for  an  hour's  lunch  break. 

When  the  G-3  returned,  he  was  given  the  Combat  Session  Briefing  (Ex- 
hibit 9)  and  OPORD  37  (Exhibit  10).  Meanwhile  the  experimenter  set  up 
the  combat  operating  environment  as  follows: 

• CRT  operation; 

1.  "LINE  SKIP"  to  "RESTART" 

2.  Type  "X"  and  press  "SEND" 

3.  Type  "6"  and  "LINE  SKIP"  to  "START  PLANNING" 

4.  Type  "X"  and  press  "SEND" 

5.  Type  "6"  and  "LINE  SKIP"  to  "START  COMBAT  SESSION" 

6.  Type  "X"  and  "SEND" 
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Type  "6"  and  "LINE  SKIP"  to  "HOLD  SESSION  (H-HALT  or  R-RELEASE) 
Type  "H"  and  press  "SEND" 

Type  "6"  and  "LINE  SKIP"  to  "CHANGE  OPERATING  ENVIRONMENT" 

Type  "X"  and  "SEND" 

"LINE  SKIP"  to  "MWrjTES  BETWEEN  UPDATES  (01-20)"  and  type  "10" 
"LINE  SKIP"  to  "MINUTES  IN  GAME  TIME  INTERVAL  (15-60)"  and 
type  "30" 

"LINE  SKIP"  to  "UPDATES  BETWEEN  SUMMARY  RECORDS  (01-12)"  and 
type  "01" 

(For  an  unaided  G-3,  to  Step  16.) 

"LINE  SKIP"  to  "LOAD  SRI  SET  NUMBER  (00-05)"  and  type  "05" 
Press  "SEND" 

Send  the  following  messages: 

• "STRT  COMBAT  HOLD" 

• "STRT  INSTRUCT" 

• Time 


The  experimenter  then  read  the  following  Instructions  for  combat  to  the 


"You  will  be  using  the  keyboard  and  CRT  during  these  phases 
to  do  more  than  just  access  the  data  base.  There  are  several 
modes  of  operation: 

1.  You  can  use  the  General  Index  and  get  Information  from  the 
data  base  just  as  you  did  earlier. 

2.  You  can  Establish  SRIs  and  you  will  be  notified  If  changes 
have  occurred  following  the  data  base  update  every  10 
minutes. 

3.  You  can  use  the  Communications  capability.  This  lets  you 
access  the  SRI  categories.  It  also  lets  you  maneuver  and 
call  In  air  strikes,  reorganize  battalion  or  company  units, 
lay  on  artillery  fires,  or  modify  unit  missions. 

4.  Aided  only:  The  CRT  display  used  during  planning  will 

contain  preestabllshed  SRIs.  After  the  commencement  of 
combat,  this  display  will  Indicate  only  those  SRIs  which 
have  changed.  You  may  access  this  Information  directly 
via  the  U,  V,  and  W options  used  previously. 
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These  operations  are  accomplished  using  the  following  pro- 
cedures : 

1.  Establish  SRI 

You  can  have  a maximum  of  30  SRIs  at  any  one  time.  To 
establish  an  SRI,  call  up  the  General  Index  and  enter 
any  of  the  sub-indexes  until  the  category  appears  for 
which  you  want  to  establish  an  SRI.  On  the  bottom  half 
of  the  screen  you  will  note  thai  the  SRI  option  appears. 
Your  procedure  would  then  be: 

a.  Enter  an  *'s"  (the  code  to  establish  an  SRI). 

b.  Depress  the  SEND  key. 

This  will  establish  an  SRI  for  the  displayed  category  of 
Information.  If  changes  occur,  you  will  be  notified  by 
message  on  your  typewriter,  and  you  can  then  access  the 
SRI  list  to  determine  the  nature  of  the  change.  This 
will  continue  until  you  cancel  the  SRI. 

2.  Monitor  SRI 

When  you  select  the  communications  (X)  option  and  depress 
the  SEND  key,  the  communications  frame  will  appear.  This 
frame  allows  you  to  monitor  your  active  SRI  titles  and 
retrieve  these  frames  directly. 

The  SRI  frame  titles  are  arranged  ten  to  a page.  If  you 
want  to  see  the  first  ten,  enter  the  digit  1 and  depress 
the  SEND  key.  To  see  the  second  ten,  either  return  to 
the  communications  frame  and  enter  the  digit  2 or  enter 
P2.  To  see  the  third  ten,  follow  the  same  procedure. 

To  retrieve  a frame,  go  to  its  page,  enter  the  associated 
digit  and  depress  the  SEND  key.  Your  only  available 
options  at  this  point  are  to  return  to  the  SRI  page  or 
to  the  communications  frame. 

3.  Delete  SRI 


To  delete  an  SRI,  go  to  the  communications  frame  (X)  and 
find  the  page  of  your  SRI  list  which  contains  the  SRI 
you  wish  to  delete.  Enter  "D"  and  the  digit  of  the  SRI 
to  be  deleted,  and  then  press  the  SEND  button.  This 
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SRI  will  then  be  deleted.  The  SRIs  which  occupied  posi- 
tions below  the  deleted  SRI  will  move  up  one  position 
to  fill  In  the  gap  and  thus  open  a position  for  another 
SRI  to  be  established  at  the  end  of  the  list. 

4.  Modify  task  organization 

If  you  want  to  modify  task  organization,  go  to  the  com- 
munications frame  and  choose  either  the  20th  Mech  Dlv 
Organic  Units  (4)' or  the  20th  Mech  Dlv  Support  Units  (5) 
and  step  down  the  organization  until  you  find  the  specific 
unit  you  wish  to  add  to  (It  must  be  at  the  operating  level 
or  below). 

You  then  enter  the  letter  "U"  and  depress  SEND.  You  add 
subordinate  units  to  the  unit  of  Interest  by  spacing  the 
cursor  down  to  the  first  three  dots  using  the  "LINE  SKIP" 
key.  Look  up  the  three  digit  code  on  the  code  sheet 
(Exhibit  11)  of  the  unit  to  be  added  and  enter  It  over 
the  three  dots.  If  more  units  are  to  be  added,  "Lli^  SKIP" 
to  the  next  three  dots  and  enter  the  unit  code,  etc.  When 
you  have  entered  all  unit  codes,  press  the  SEND  key  and 
reorganization  will  take  •’’ace. 

5.  Modify  unit  mission 

If  you  want  to  modify  the  mission  of  a unit,  go  to  the  com- 
munications frame  and  choose  either  the  20th  Mech  Dlv 
Organic  Units  (4)  or  the  20th  Mech  DJv  Support  Units  and 
step  down  the  organization  to  the  specific  unit. 

You  then  enter  the  letter  "Z"  and  depress  SEND.  A frame 
containing  a list  of  the  types  of  missions  will  then  appear. 
The  current  mission  of  the  unit  of  interest  will  have  the 
unit's  coordinates  listed  after  It.  To  change  the  mission, 
LINE  SKIP  the  curso-  down  to  the  dot  opposite  the  line 
which  says  "change  mission"  and  enter  the  number  of  the 
new  mission.  Then  LINE  SKIP  to  the  six  dots,  enter  the 
new  coordinates,  and  press  the  SEND  key.  The  new  mission 
and  the  new  coordinates  of  the  unit  will  then  appear. 


m' 
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6.  Resource  allocation 


In  order  to  allocate  air  strikes  and  tactical  fires, 
find  the  coordinates  of  the  unit  or  units  you  wish  to 
fire  upon.  Go  to  the  Corjnunlcatlons  frame  (X)  and  select 
option  ”6".  On  the  frame  that  appears,  enter  the  six 
digit  coordinate  of  the  location  to  be  fired  upon  and 
press  SEND.  You  will  then  have  displayed  those  friendly 
units  within  range  of  firing  on  the  target. 


To  assign  a fire  mission,  enter  the  number  opposite  the 
unit  you  wish  to  have  fire  and  press  SEND.  The  unit  will 
then  fire  its  standard  number  of  volleys  (or  sorties  for 
tactical  air  strikes) . If  you  wish  the  unit  to  fire 
more  than  Its  standard  number  of  volleys,  enter  the 
number  opposite  the  unit  you  wish  to  fire  and  then  the 
multiplication  facto',  (i.e.,  entering  the  digit  2 would 
double  the  volleys,  entering  the  digit  3 would  tripe  the 
volleys,  etc.). 


Remember,  however,  that  once  a unit  has  been  assigned  to 
fire,  it  will  be  committed  to  do  so  until  after  the  next 
update. 


An  update  is  a short  period  of  time  (about  30  seconds)  that  the 
computer  uses  to  Incorporate  the  inputs  you  have  made  and  also 
those  directives  which  have  been  pre-planned  for  the  opposing 
forces.  With  the  exception  of  the  first  one,  the  updates  will 
take  place  every  ten  minutes.  During  the  update,  a message  of 
the  form  "update  //  in  progress  for  station  //  " will 


appear  on  your  CRT  and  you  will  be  locked  out  of  the  system  for 
the  30  seconds.  At  the  end  of  that  time,  a message  of  the 
form  "update  //  has  ended  for  station  //  " will  appear 


on  your  CRT,  and  you  again  have  control  of  the  system. 


In  order  to  give  you  time  to  orient  yoursexr  to  the  combat  pro- 
cedures by  reviewing  your  SRI  list,  setting  up  f.rtiller:'  fires 
and  air  strikes,  etc.,  we  have  extended  the  first  update  period 
to  30  minutes,  after  which  combat  will  start.  Remember  that 
any  inputs  you  make  during  this  extended  update  will  be  used 
for  the  first  update. 
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You  have  available  three  overlays  which  you  can  put  on  the 
map  If  and/or  when  you  need  them.  They  are: 


• Key  terrain  and  avenues  of  approach 

• Blocking  positions 

• Maximum  lines  of  penetration 


Time  is  0400.  The  first  update  will  be  at  0530  and  combat  will 
run  until  1130. 


If  you  have  any  questions  or  If  you  want  a break,  please  contact 
me  via  the  telephone. 


After  these  Instructions,  the  experimenter  returned  to  his  station  to 
Input  these  messages  and  start  the  combat  hold  phase: 

• Messages : 


1. 

"END  INSTRUCT" 

2. 

Time 

3. 

"STRT  COMBT  HOLD" 

CRT 

operation: 

1. 

Type  "6"  and  "LINE 

SKIP"  to 

2. 

Type  "X"  and  press 

"SEND" 

3. 

Type  "6"  and  "LINE 

SKIP"  to 

4. 

Type  "H"  and  press 

"SEND" 

After  30  minutes,  the  experimenter  released  combat  and  Input  the  follow- 
ing messages: 

• CRT  operation: 


1.  Type  "6"  and  "LINE  SKIP"  to  "HOLD  SESSION" 

2.  Type  "R"  and  press  "SEND" 
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• Message 

1.  "COMBAT  RELEASE" 

2.  Time 


The  combat  session  ran  for  12  updates.  After  the  12th  update,  the  ex- 
perimenter "logged  out"  the  G~3  and  input  the  end  messages  as  follows; 

• CRT  operation: 

1.  Type  "6"  and  "LINE  SKIP"  to  "LOG  OUT" 

2.  Type  "X"  and  press  "SEND" 

• Messages : 

1.  "COMBAT  END" 

2.  "CLOCK  STOP" 

3.  Time 

The  G-3  was  asked  to  complete  the  Personnel  Data  Sheet  (Exhibit  12) . 
Following  any  questions  the  consultant  may  have  had,  the  session  was 
concluded . 


3.3.4  Data  Format 


Two  types  of  raw  data  were  available  from  the  evaluation ; hand  written 
responses  and  computer  record  printouts.  The  DSMI  data  was  manually 
gathered  by  the  experimenter.  Response  Sheets  1,  2 and  3 contained  the 
written  defensive  plans  generated  by  each  G-3  during  the  planning  session, 
supplemented  by  one  overlay  depicting  the  G-3's  defensive  plan.  Other 
G-3  generated  materials  Included  the  SRI  list  and  the  personnel  data  sheet. 
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3.3.4  Data  Format 


All  Interactions  Involving  the  computer  were  recorded  on  magnetic  tape 
and  provided  on  a computer  output  summary  for  each  G<-3's  participation. 

s 

This  nummary,  called  a "track  file,"  contained  the  following  Informa- 
tion during  planning: 

• Subject  number 

• Time  In  seconds  between  each  Input  to  the  system 

• Number  of  the  frame  which  appeared  on  the  CRT  scope 
(Aid  frames  were  preceded  by  the  word  "Transfer.") 

• Messages  Input  by  the  experimenter 

During  combat,  the  track  file  contained  all  of  the  above  data,  plus  a 
summary  of  the  following  after  each  upaate: 

• Units  that  fired  weapons  during  the  update,  including 

1.  unit  numbers (s) 

2.  X and  Y coordinate  position 

3 . unit  name 

4 . weapon  number 

5.  number  of  volleys  or  sorties 

• Event  number 

• Total  force  status.  Including 

1.  unit  number(s) 

2.  X and  Y coordinate  position 

3 . mission 

4.  situation 

5.  general  attrition 

6.  weapon  attrition  and/or  expenditure 
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7.  subordinate  unit  numbers 

8 . unit  names 


An  example  of  a track  file  for  planning  is  shown  In  Table  3-2  and  an 
example  for  combat  Is  sLown  in  Table  3-3. 


Table  3-2,  Track  File  Susmary;  Planning  Data 


RECORD 

TYPE 

SUBJ 

NO* 

■)PIG 

TIME 

frahe  or 
message 

I 

103 

1 

61?b 

33 

1 

103' 

1 

6130 

331 

1 

103 

1 

6136 

3311 

1 

103 

1 

61S6 

331 

1 

103 

1 

616) 

3312 

1 

103 

1 

6l«9 

331 

1 

103 

1 

6?  00 

3313 

1 

103 

1 

6?4b 

331 

1 

103 

1 

6251 

J314-« 

1 

103 

1 

62f>/ 

33.1 

1 

103 

1 

62<4h 

1 

103 

1 

6300 

332 

1 

103 

1 

6317 

3325 

1 

103 

? 

6364 

332 

1 

103 

1 

637t. 

33 

1 

103 

1 

63  7S 

331 

1 

103 

1 

63m| 

3314 

1 

103 

1 

63PH 

33141 

1 

103 

1 

6444 

J3H 

1 

103 

1 

654(i 

5 

103 

1 

657  ) 

TRANSP^" 

1 

l'\3 

1 

65  M 

2842 

5 

103 

1 

671  V 

ThANSi^ 

1 

103 

1 

6719 

0.35 

b 

103 

1 

6771 

IRAMSPI"'* 

1 

103 

1 

6771 

2.522 

b 

li)3 

1 

6«P2 

IRANSPt--' 

1 

103 

1 

6AH2 

035 

b 

103 

1 

69<^7 

IRANSPf- 

1 

103 

1 

69c,7 

PPlbl 

b 

103 

1 

6976 

IRANSFl 

1 

10  3 

1 

6976 

2536 

5 

103 

1 

699  1 

IRA-  SFF9 

1 

103 

1 

699  3 

2841 

b 

103 

1 

7f.  3r 

TKAt'!S=^»  L. 

1 

103 

1 

703« 

33 

b 

103 

1 

705b 

TRArSF't* 

1 

103 

1 

705b 

33U 

b 

103 

1 

70H6 

TRANSPt-- 

1 

103 

1 

7086 

.17 

b 

103 

1 

71  U 

iHAiMSPf^. 

1 

103 

1 

7112 

7,12 

1 

103 

1 

71  19 

7,1 

1 

103 

1 

714b 

1 

103 

1 

7152 

2 

1 

103 

1 

7157 

21 

1 

103 

1 

716  3 

211 

1 

103 

1 

71113 

21 

1 

1()3 

1 

71«9 

212 

1 

103 

1 

7?.-,2 

21 

CP  X Y MIS  SIT  ATT  ATT 

UNIT  PoS  PCS  GEN 


•Data  Point 


«€COW&-S06>i-OR|C-T-f»fe-  -Ot^  OP  * V MIS  SlT  ATX  ATT  SUHOROINAit  KCAPON  VOU.CXS  SOBT^ 

TYPE  NO.  message  UNIX  POS  POS  SEN  8U  UNITS  NUMBER 


37 


X 

Z 

o 

o 

X 

Z 

z >- 

z >* 

2ZZCDKZZ20DK 

IS  OD  CD  CC  CD  ^D 

^ a 

< < 

NNl  fV  2 MMtV 

z 

< H- 

ZZXH>(dZZZ 

►-ID 

Ui 

9999X444444 

44  QC 

00 

1 I 


(MrvicO(\j(>Jcvru-^ 
I • O I I I I 
m mrntu  m4(\t  ff) 


oooooooooo 

0000000^00 

OOOOOOOOOO 

oooooooooo 


0000*000^0# 
9 9 

«n 

oo  009^  ooooo 
•«  u> 

ro  r*> 

fO  l») 

«cc4^ccrg<«e#ccfu 


^(T^c'cacro’^c 

5‘TaaO(^0‘(^<^0 

^ ^ 0-  M 


7*0  0(^07*  T07*0 

j — -4  -N 


■ i 

'VT^irrutfi'v>*VJ'»vxi 
i/>**-04.u'oaL0cT(r 
f\i  cu  i\»  cx<  tv  t\j  IV  f . «v  r. 

4^ruepM(/)#>^Ooo 

IV  m tv  tv  f ■ 

’’■f 


I C 9 o <t  0*  U 
» t *\j  "n  "h  ■ 


. 4 ^ » 1.4  .44 

T T T 1 i ! T ' 


#tcrv<cc  <«oL^^e 


u.  u.  u. 

if)  i/i  f/t  a 

2*-«zrgz'vsrv 

I Z^Z9X9XCD 
►-nj>-fUH-(\uv«v 


pH  •M44tMpH<fi*44«M44<MpHpM^.^44p*«t.4^44 
pH  .^M<MpH<Mp«^pH<HH**f*«~****H4pHOT«.^p.« 


^ ^ Aj  -n  # 
If  j-  « ^ C 
r*  fW  X « O' 


44  p^  pH  Pf«  P 
- Pf.P  - • 


I ‘ ’ 


4«  «HpH  44pH  I 
f*4  pH  ppp  pHp4i 

r — 


Table  3-3,  Track  File  Summary;  Combat  Data 


38. 


Section  4 Results 
3.4.1  Overview 

The  results  of  the  evaluation  were  reduced,  analyzed  and  evaluated 
separately  for  the  planning  and  combat  play  sessions.  Within  each 
session,  the  data  was  organized  according  to  tactical  performance  and 
Information  processing  measures.  Due  to  the  preliminary  nature  of  this 
Investigation,  the  analysis  was  largely  descriptive  In  nature.  According 
ly,  means,  standard  deviations,  and  confidence  Intervals  were  the  primary 
statistics  used  to  present  the  results. 

For  each  measure  within  phases,  the  results  were  com  ired  between  groups 
(aided  versus  unaided),  between  style  dimensions  (Active  versus  Passive, 
Logical  versus  Intuitive,  and  High  Abstract  versus  Low  Abstract  versus 
Concrete)  and  within  style  dimensions  (aided  versus  unaided~Actlve , 
aided  versus  unaided-Passive,  aided  versus  unalded-Logical,  etc.)  These 
comparisons  addressed  the  experimental  questions  posed  regarding  both 
aid  efficacy  and  the  interaction  of  aid,  decision  style,  and  performance. 

The  means  and  standard  deviations  for  each  measure  across  all  groups 
are  contained  In  Tables  3-6  through  3-11,  The  graphs  for  each  of  the 
measures  are  contained  in  Appendix  ?.  The  data  in  its  entirety  is 
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presented  in  the  tables  and  graphs  listed  above;  the  remaining  para- 
graphs of , this  section  will  identify  trends  in  the  data  according  to 
each  measure.  Further,  the  derivation  and  rationale  for  each  measure 
is  presented. 

The  use  of  inferential  statistics  was  j^ited  due  to  the  small  sample 
size  and  heterogeneity  of  variance,  especially  in  the  aided  condition 
group.  This  effect  was  further  compounded  in  the  style  subgroups  by 
unequal  sample  sizes. 

3. A. 2 Decision  Style  Measurement 


As  previously  indicated,  the  form  of  the  adaptive  estimate  of  the  situ- 
ation aid  was  determined  by  the  scores  on  the  Decision  Style  Measurement 
Instrument  (DSMI).  At  its  present  stage  of  development,  the  DSMI  is 
presumed  to  provide  a nominal  indication  of  style  on  each  of  three  bi- 
polar dimensions:  Active-Passive,  Logical- Intuitive,  and  Abstract- 

Concrete.  These  three  scales  yield  eight  possible  combinations  of  de- 
cision styles.  The  styles  observed  in  the  studv  sample  are  presented 
in  Table  3-A. 


1 


A frequency  plot  of  scores  on  the  Abstract-Concrete  dimension  (Figure 
3-3)  yielded  a distribution  of  one  Concrete  score,  seven  Low  Abstract 
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scores,  and  two  High  Abstract  scores.  When  aided  versus  unaided  groups 
were  compared  using  this  dimension,  only  the  Low  Abstract  Individuals 
were  Included,  due  to  the  small  numbers  Involved.  Although  the  High 
Abstract  and  Concrete  scores  are  shown  In  the  tables  and  graphs,  these 
should  not  be  considered  as  reflecting  any  trends  In  the  data. 


Table  3-4.  Observed  Decision  Styles 


Actlve/Abstract/Loglcal 

1 

Actlve/Abstract/Intc*  tlve 

3 

Actlve/Concrete/Loglcal 

Actlve/Concrete/Intultlve 

Passlve/Abstract/Loglcal 

4 

Passlve/Abstract/Intultlve 

Passive/ Concrete/Logical 

Passive/ Concrete/Intuitive 

1 

Tle/Abstract/Intultlve 

1 

10 

3.4.3  Consultant  Background 


Background  Information  was  gathered  on  each  of  the  participating  tac- 
ticians In  the  form  of  a post  experimental  questionnaire  (Appendix  A, 
Exhibit  13) . This  Information  Is  summarized  In  Table  3-5 . The  aided 
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Table  3-5.  Consultant  Background  Data  Simmary 


1 

AIDED 

UNAIDED 

TOTAL 

Rank 

Colonels 

1 

Colonels 

1 

Colonels 

2 

Lt.  Colonels 

3 

Lt.  Colonels 

3 

Lt.  Colonels 

6 

Majors 

1 

Majors 

1 

Majors 

2 

Average  Age 

43.8 

42 

42.9 

Average  Years  of 

■ 

■ 

■ 

Service 

20.5 

■ 

18.6 

■ 

19.6 

■ 

Type  of  Military 

Infantry 

3 

Infantry 

3 

Experience 

ARMD  CAU 

1 

ARMD  CAU 

3 

ARMD  CAU 

4 

ARTY 

1 

ARTY 

2 

ARTY 

3 

Percent  of  G-3 

40% 

■ 

40% 

40% 

Average  Combat 

■ 

■ 

(Months) 

12 

■ 

10.4* 

■ 

11.2 

Average  Years  since 

■ 

■ 

■ 

Graduation  (CGSC) 

8.2 

■ 

6 

■ 

1 

Education 

Bachelor's 

Bachelor's 

Bachelor's 

Degree 

5 

Degree 

5 

Degree 

Graduate 

Graduate 

Graduate 

Work 

3 

Work 

3 

Work 

6 

Percent  with  Tactlfal 

■ 

■ 

■ 

Map  Exercises 

80% 

■ 

40% 

60% 

■ 

(Germany 

■ 

■ 

■ 

Four  of  the  five  consultants  had  12  months  of  combat. 

The  fifth  consultant,  with  4 months  of  combat,  reduced  the  mean 
to  10.4  months. 


m 


m 


■ 


3.4.3  Cjinsultant  Background 


and  unaided  groups  were  found  to  be  similar  on  most  characteristics. 
The  only  discrepancies  Involved  recency  of  attendance  at  Command  and 
General  Staff  College  and  participation  in  tactical  field  exercises  in 
Europe. 


The  recency  factor  favored  the  unaided  group  (2.2  years).  While  this 
factor  has  been  correlated  with  performance  in  SIMTOS,  experience  beyond 
five  years  did  not  discriminate  between  participants  (Krumm,  Robins  and 
Ryan,  1973).  Note  that  for  the  unaided  group,  the  mean  recency  is  six 
years.  The  effects  of  the  recency  factor  in  the  present  evaluation 
should  be  negligible. 


The  fact  that  four  aided  officers  had  participated  in  tactical  field 
exercises  in  Europe  (as  opposed  to  two  in  the  unaided  group)  is  likewise 
of  little  consequence  to  the  results  of  this  study.  The  study  partici- 
pants who  had  field  exercise  experience  held  a variety  of  roles,  and 
'any  systematic  effects  could  not  be  determined. 


3.4.4  Planning:  Tactical  Performance 


The  planning  session,  to  reiterate,  consisted  of  two  phases.  The  first 
phase,  the  Recommendation  of  a Course  of  Action,  consisted  of  the 
assignment  of  the  maneuver  units  to  defensive  positions.  T?<e  second 
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phase,  the  Development  of  the  20th  Mechanized  Division  Task  Organization, 
contained  the  concept  of  the  maneuvers  and  mission  statements.  In  both 
phases  the  tasks  required  the  G-3's  to  respond  by  filling  In  response 
sheets  by  hand.  The  scoring  of  these  response  sheets  comprised  the 
tactical  performance  evaluation  of  the  G-3's  during  planning. 

The  procedure  for  scoring  the  planning  response  sheets  was  derived  from 
Army  Command  and  General  Staff  College  Norms  presented  by  the  Bunker-Ramo 
Corporation  (Bunker-Ramo,  1973).  This  procedure  was  used  In  the  present 
evaluation  of  tactical  performance  for  the  planning  session. 

The  scoring  consisted  of  assigning  (or  not  assigning,  in  some  cases) 
points  to  segments  of  the  G-3's  written  responses.  The  total  possible 
points  available  with  this  procedure  was  59.  Earlier  studies  evaluating 
the  planning  session  on  SIMTOS  obtained  average  scores  of  27.1  with  a 
range  of  15  to  36  (Robins,  Buffardi  and  Ryan,  1973).  In  the  present 
evaluation,  the  mean  score,  with  N = 10,  was  somewhat  lower — 23.7,  with 
a range  of  17  to  28.  Note,  however,  that  in  the  study  by  Robins  and 
associates,  the  planning  session  was  three  hours  long  while  In  the 
present  evaluation.  It  was  only  two  hours. 

Total  scores  for  planning  show  that  unaided  individuals  did  slightly 
bettir  than  aided  with  a mean  score  of  24.8  (S.  D.  3.42)  in  contrast  to 
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the  aided  mean  of  22.6  (with  an  S.  D.  of  4.16).  The  means  are  plotted 
in  Figures  B-1,  B-2,  and  B-3.  Overall,  the  unaided  groups  scored  slightly 
higher  than  the  aided  group.  Within  the  style  groups,  the  unaided  G-3's 
tended  to  score  higher  than  the  aided  G>3's. 

3.4.5  Planning:  Information  Processing 

Five  measures  were  developed  to  evaluate  the  information  processing  of 
the  G-3’s  during  the  planning  session.  They  are: 

• sources  sought 

• action  ratio 
redundancy  ratio 

• error  ratio 

• information  acquisition  ratio 

The  derivation  of  these  measures  from  the  data  and  the  results  are 
described  below. 

The  SIMTCS  data  base  is  divided  into  ten  categories  of  Information. 

The  first  information  processing  measure,  sources  sought,  is  an  iiidicant 
of  how  many  of  these  categories  were  used  by  the  G-3  evaluators  to 
work  the  SIMTOS  tasks.  For  each  phase  of  the  task,  the  measure  was 
derived  by  dividing  the  number  of  categories  queried  during  a phase 
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by  the  number  of  categories  available  to  query  (i.e.,  ten).  Thus, 
the  higher  the  ratio,  the  more  categories  queried. 

The  means  and  standard  deviations  for  the  groups  during  planning  for 
the  sources  sought  measure  are  presented  In  Tables  3-6  and  3-7.  The 
means  are  graphed  In  Figures  B-4  through  B-9.  There  Is  little  difference 
between  the  aided  and  unaided  groups  In  the  number  of  sources  sought 
during  planning.  The  active  and  the  Intuitive  groups,  however,  tend  to 
query  more  categories  than  either  the  passive  or  logical  groups, 
respectively. 

The  second  Information  processing  measure,  action  ratio,  was  derived 
for  each  phase  by  totaling  the  number  of  queries  made  In  each  of  the 
ten  categories  and  dividing  this  total  into  the  number  of  times  each 
category  was  queried.  The  resultant  ratio  indicates  how  individuals 
obtain  their  information  from  the  data  base.  The  higher  the  ratio, 
the  more  times  categories  were  returned  to  for  information. 

The  means  and  standard  deviations  for  the  action  ratio  during  planning 
are  shown  in  Tables  3-6  and  3-7.  The  graphs  of  the  means  are  contained 
in  Figures  B-10  through  B-25.  There  are  almost  no  differences  between 
' the  groups  on  this  measure. 

i 
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Error  ratio,  the  third  measure,  was  derived  by  dividing  the  total 
number  of  system  usage  errors  by  the  total  number  of  Interactions  the 
G-3's  had  with  the  system.  Error  ratio  is  an  indicator  of  how  well 
the  G-3*s  were  able  to  master  the  operation  of  the  system:  the  higher 

the  ratio,  the  more  system  usage  errors. 

The  ratios  for  this  measure  were  so  small  (<  .07)  that  no  differences  be- 
tween groups  appear.  The  means  and  standard  deviations  for  planning 
are  shown  in  Tables  3-6  and  3-7,  and  the  graph  of  the  means  for  aided 
and  unaided  groups  are  contained  in  Figure  B-26. 

The  fourth  measure,  redundancy  ratio,  was  derived  by  dividing  the  total 
number  of  redundant  queries  by  the  total  number  of  data  base  queries. 

The  ratio  Indicates  the  number  of  times  the  same  piece  of  information 
was  queried  by  a G-3  during  the  task. 

The  means  and  standard  deviations  for  planning  are  shown  in  Tables  3-6 
and  3-7 . The  means  for  each  phase  have  been  graphed  in  Figures  B-27 
through  B-33.  Throughout  the  planning  session,  the  aided  group  is 
more  redundant  than  the  unaided  group.  Also,  the  intuitive  group  is 
consistently  more  redundant  than  the  logical  group  throughout  planning. 

In  both  phases  of  planning  the  active  group  is  more  redundant  than  the 
passive  group. 
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In  the  Procedure  section,  the  method  for  querying  the  data  base  was 
described  in  detail.  The  method  forces  the  G-3  to  choose  one  frame  at 
a time  in  a vertical  manner  through  the  data  base  structure.  Since 
each  frame  picked  appears  on  the  track  file,  a G-3’s  path  can  be  fol- 
lowed. A "data  point"  has  been  defined  as  the  frame  in  the  data 
structure  from  which  the  G-3  starts  to  move  back  up  the  data  structure 
(i.e.,  either  by  returning  to  the  previous  frame  or  by  returning  to  the 
"General  Index"  frame) , An  example  of  a "data  point"  is  shown  by  the 
arrow  in  Table  3-2. 

Information  acquisition,  the  fifth  measure  was  derived  by  totaling  the 
number  of  data  points  and  dividing  this  total  by  the  total  number  of 
data  base  queries.  The  ratio  shows  how  many  responses  were  required  to 
obtain  a piece  of  Information.  It  is  thus  an  indicant  of  either  aid 
usage  or  depth  of  query  into  the  data  base  structure. 


The  means  and  standard  deviations  for  information  acquisition  during 
planning  are  shown  in  Tables  3-6  and  3-7.  These  means  are  plotted  in 
Figures  B-34  through  B-39.  The  aided  group  has  higher  ratios  of  inf or 
mation  acquisition  than  the  unaided  group  during  planning.  Both  the 
intuitive  and  active  groups  have  higher  ratios  than  the  logical  and 
passive  groups,  respectively. 
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The  SIMTOS  Defensive  Scenario  Combat  Performance  Scoring  Criteria 
(Bunker-Ramo,  1973)  list  five  factors  "determined  to  be  of  significant 
importance  in  assessing  combat  performance  during  defensive  operation." 
They  are: 

• friendly  force  attrition 

• enemy  force  attrition 

• friendly  force  artillery  expenditure 

• friendly  force  air  strikes  expended 

• distance  surrendered 

Two  additional  measures  derived  from  the  data  and  used  in  the  present 
evaluation  were; 

• events 

• objectives  reached 

As  events  are  the  main  indicants  of  success  in  operation  of  the  simula- 
tion, their  explanation  and  derivation  will  be  presented  first. 

In  this  simulation,  directives  for  (instruction  to)  enemy  units  are 
triggered  by  movement  of  those  units.  When  enemy  units  penetrate  a 
specified  distance  into  friendly  territory  (cross  an  event  line) , new 
directives  for  that  unit  are  Issued  by  the  computer.  This  process  is 
an  "event,"  and  the  track  file  indicates  after  each  update  what  event 
combat  is  in.  Thus,  the  event  measure  is  the  number  of  events  triggered 
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by  the  advancing  army  across  the  updates.  Because  simulation  operation 
centers  around  events,  this  measure  should  correlate  highly  with  other 
combat  measures. 

Across  all  tactical  measures,  a deviation  In  performance  was  noted  In 
one  G-3  (//lOl) . An  example  of  this  difference  can  be  noted  by  looking 
at  Individual  curves  for  this  measure  In  Figure  B-40.  Participant  #101, 
in  contrast  to  the  others  in  the  study,  held  the  enemy  at  two  events 
from  the  second  update  until  the  end  of  the  problem.  In  the  graphs  for 
this  measure,  a curve  for  each  group  of  individual  including  #101 
(where  it  is  applicable)  and  another  without  #101  is  shown  to  demonstrate 
the  effect  of  his  data  upon  the  trends. 

Table  3-8  shows  the  means  and  standard  deviations  for  events  at  the  end 
of  the  problem.  Figures  B-41  through  B-50  depict  the  means  for  events 
graphed  across  update.  Even  when  #101 ’s  performance  is  removed,  the 
aided  groups  ends  having  triggered  slightly  fewer  events  than  the  unaided 
group.  The  events  also  occur  less  rapidly  across  updates  for  the  aided 
group.  However,  there  are  almost  no  style  differences  for  events 
without  #101 's  performance. 

Because  of  the  increased  variance  caused  by  #101 's  data,  the  trends  in- 
dicated in  the  graphs  of  tactical  measures  tend  to  be  artificial.  For 
this  reason,  although  descriptive  statistics  are  provided  in  Tables  3-8 
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and  3-9,  and  graphs  for  each  measure  are  available  in  Appendix  B,  de- 
tailed analysis  of  each  measure  will  not  be  provided  in  the  Resxxlts 
Section.  Only  those  trends  of  particular  Interest  will  be  discussed. 
While  the  five  factors  listed  by  Bunker-Ramo  (1973)  were  used  in  the 
present  evaluation,  they  were  computed  directly  from  the  track  files, 
as  described  below,  rather  than  according  to  the  procedures  detailed 
by  Bunker-Ramo  (1973) . 


On  the  track  files,  the  percentages  shown  under  general  attrition  in- 
dicate the  remaining  strength  of  units.  In  order  to  compute  attrition 
(both  friendly  and  enemy),  percentage  of  losses  were  summed  across  all 
units  for  a single  update  and  divided  by  the  total  nximber  of  units 
suffering  losses  by  the  end  of  the  task.  This  yielded  an  average 
percentage  lost  per  update  for  the  friendly  and  enemy  forces  during 
each  G-3's  combat  session. 


Table  3-9  shows  means  and  standard  deviations  for  friendly  force  attri- 
tion for  all  groups.  Figures  B-51  through  B-60  provide  a graphical 
representation  of  the  means  across  updates.  Although  friendly  force 
attrition  is  a cumulative  measure  which  yields  only  rising  curves, 
there  is  one  case  where  attrition  dropped  between  two  updates  (See  *, 
Figure  B-52) . One  G-3  (#101)  recombined  units  in  such  a way  that  the 
organization  cancelled  out  losses  that  had  previously  occurred. 
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Excluding  the  attrition  of  //lOl's  forces,  there  is  almost  no  difference 
in  friendly  force  attrition  between  aided  and  unaided  groups  or  between 
styles. 

The  means  and  standard  deviations  for  enemy  force  attrition  are  pro- 
vided in  Table  3-9.  Figures  B-61  through  B-70  show  the  plotted  means. 
While  overall  there  is  not  much  difference  between  the  aided,  unaided 
or  style  groups  without  the  effects  of  IflOl,  it  is  interesting  to  note 
that  there  is  much  more  variab"'ity  within  the  aided  group  than  the 
unaided  group  in  the  percentage  of  enemy  attrition. 

Since  each  unit's  coordinates  are  given  after  each  update  on  the  track 
file,  a specific  unit's  path  can  be  plotted.  To  derive  distance  sur- 
rendered, each  enemy  unit's  path  was  measured  (in  centimeters  and  con- 
verted to  kilometers)  from  the  point  at  which  it  crossed  the  international 
border  (the  Weisse-Elster  River)  to  its  end-point  after  the  12th  update. 
Average  distance  surrendered  for  each  update  was  thus  conq>uted  by  sum- 
ming the  distance  surrendered  for  all  units  and  dividing  by  the  total 
number  of  units  that  moved  across  the  international  border  during  the 
course  of  combat. 


The  means  and  standard  deviations  of  distance  surrendered  are  contained 


in  Table  3-9.  The  means  have  been  graphed  in  Figures  B-71  through  B-78. 
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Again,  without  the  effects  of  iflOl,  little  or  no  difference  is  found 
between  groups  on  this  measure. 


Friendly  force  weapon  expenditures  was  broken  down  into  the  three  types 
of  artillery  available  and  tactical  air  strikes.  The  percentage  of 
available  tire  power  used  was  calculated  for  each  weapon  for  each 
update.  For  the  artillery  (155  millimeter  guns,  8-inch  guns  and  Honest 
Johns),  the  percentage  consisted  of  the  total  number  of  rounds  expended 
(summed  for  all  batteries)  compared  to  the  total  number  of  rounds 
available  (the  total  available  for  each  battery  times  the  number  of 
batteries) . Tactical  air  expenditure  was  the  percentage  of  planes 
dispatched  during  each  update  compared  to  the  total  number  of  planes 
available.  (Once  a plane  was  used,  it  was  not  available  for  the  rest 
of  the  combat  session.) 


The  means  and  standard  deviations  for  this  measure  are  presented  in 
Table  3-8.  Figures  B-79  through  B-114  show  weapon  expenditure  for  the 
three  types  of  artillery  and  for  tactical  air  strikes  for  each  G-3. 
Again,  without  the  effects  of  #101,  the  differences  between  groups 
are  negligible. 


Enemy  units  were  given  directives,  according  to  event,  to  move  toward 
a certain  location  or  "objective."  On  the  track  file,  the  situation 
codes  indicate  when  a mission  has  been  accomplished.  Objectives  reached 
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is  thus  the  total  number  o'  missions  accomplished  by  all  units  across 
all  updates. 

The  means  and  standard  deviations  for  objectives  reached  are  contained 
In  Table  3-8.  The  graphs  of  these  means  across  updates  for  the  aided 
versus  unaided  participants  are  shown  in  Figure  B-115.  G-3  #101 's  per- 
formance for  this  measure  again  Inflates  any  differences  between  groups. 

3.4.7  Combat:  Information  Processing 

This  section  contains  the  results  of  the  evaluation  of  the  G-3's  in- 
formation processing  during  the  combat  phases  of  the  task.  The  five 
measures  used  to  evaluate  planning  performance  are  again:  sources  sought, 

action  ratio,  error  ratio,  redundancy  ratio,  and  Information  acquisition 
efficiency.  The  derivation  of  these  measures  for  combat  data  was  the 
same  as  described  above  for  the  planning  data.  In  addition,  two  measures 
unique  to  resource  allocation  during  combat  were  used:  efficiency  ratio 

and  firing  time. 

Tables  3-10  and  3-11  show  the  means  and  standard  deviations  for  sources 
sought  during  combat.  The  meaas  are  graphed  In  Figures  B-4  through  B-9. 
The  aided  and  unaided  G-3’s  sought  approximately  the  same  number  of 
sources  during  combat.  There  is  almost  no  difference  between  the  logical 
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and  Intuitive  groups  on  this  measure.  During  the  dynamic  phase  of  com- 
bat, however,  the  active  group  sought  more  sources  than  the  passive 
group,  due  to  the  larger  ntimber  of  sources  by  the  unaided  active  G'3's. 

The  means  and  standard  deviations  during  combat  for  the  action  ratio 
are  presented  In  Tables  3-10  and  3-11.  The  means  are  plotted  In  Figures 
B-10  through  B-25.  While  there  Is  no  difference  during  the  dynamic 
phase  of  combat,  the  aided  group  has  a higher  action  ratio  than  the 
unaided  during  the  static  phase  of  combat.  However,  little  difference 
exists  between  style  groups  on  this  measure. 

The  error  ratio  means  and  standard  deviations  for  combat  are  shown  In 
Tables  3-10  and  3-11.  The  means  are  graphed  In  Figure  B-26.  Again, 
as  for  planning,  the  error  ratios  during  combat  were  so  small  that  no 
differences  between  groups  appear. 

Tables  3-10  and  3-11  show  the  means  and  standard  deviations  for  redun- 
dancy ratio  during  combat.  These  means  are  graphed  by  group  In  Figures 
B-27  through  B-33.  The  aided  group  Is  more  redundant  during  combat  than 
the  unaided  group.  The  Intuitive  group  is  slightly  more  redundant 
during  combat  than  the  logical.  For  the  active  and  passive  groups, 
however,  the  active  G-3*s  are  more  redundant  than  the  passive  during 


the  static  phase,  but  the  trend  Is  reversed  during  the  dynamic  phase. 
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The  means  and  standard  deviations  for  information  acquisition  ratios 
during  combat  are  shown  in  Tables  3-10  and  3-11.  Figures  B-34  through 
B-39  show  these  means  graphed.  The  aided  group  has  higher  ratios  in 
combat.  The  intuitive  group  has  a much  higher  ratio  during  the  static 
phase  than  the  logical  group,  but  there  is  little  difference  between 
these  groups  during  the  dynamic  phase. 

The  first  measure  of  resource  allocation  during  combat,  usage  efficiency, 
was  computed  by  dividing  the  total  number  of  times  that  units  were  as- 
signed to  fire  by  the  number  of  times  the  resources  allocation  loop  was 
entered.  The  ratio  thus  shows  how  many  units  were  assigned  to  fire 
each  time  the  resource  allocation  loop  was  queried.  To  associate  a 
higher  ratio  with  higher  efficiency,  all  ratios  obtained  were  subtracted 
from  one.  The  means  and  standard  deviations  for  usage  efficiency  are 
shown  in  Table  3-9.  The  means  are  graphed  in  Figures  B-116  and  B-117. 
There  is  almost  no  difference  between  the  aided  and  unaided  groups  or 
between  the  logical  and  intuitive  groups.  The  passive  group,  however, 
has  a higher  usage  efficiency  than  the  active  group. 

Firing  time,  the  second  measure  of  resource  allocation,  was  derived  by 
dividing  the  time  spent  assigning  units  to  fire  by  the  total  number  of 
times  units  were  assigned  to  fire.  The  measure  thus  shows  the  average 
tlafe  spent  to  assign  fires.  The  means  and  standard  deviations  for 
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firing  time  are  shown  In  Table  3-9.  The  means  have  been  graphed  In 
Figures  B-118  and  B~119.  The  unaided  group  took  longer  to  assign 
fire  missions  than  the  aided  group.  Although  there  was  little  difference 
between  the  active  and  passive  groups,  the  Intuitive  group  look  longer 
to  fire  than  the  logical  group,  largely  as  a result  of  the  unaided 
Intuitive  G-3's. 
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Section  5 Discussion 


3.5.1  Overview 


In  this  section  the  relationship  between  the  observed  performance  in  this 
preliminary  investigation  and  the  implemented  decision  aiding  complex 
will  be  presented.  Since  the  aiding  complex  differed  in  both  a qualita- 
tive and  a quantitative  fashion  between  the  planning  and  combat  sessions, 
the  discussion  will  treat  these  sessions  separately. 


It  was  hypothesized  that  in  both  sessions  the  aided  group's  performance 
would  be  superior  to  that  of  the  unaided  group  on  both  tactical  and 
information  processing  measures.  The  ability  to  answer  these  questions 
definitively  requires  a large  sample  of  G-3  officer  consultants  due  to 
the  characteristically  high  performance  variability  in  tasks  as  com- 
plex as  those  in  the  SIMTOS  scenario.  This  was  not  the  case  in  the 
present  investigation.  Therefore,  much  of  this  discussion  will  involve 
subjective  interpretation  of  the  data  in  an  effort  to  identify  meaningful 
performance  trends. 

There  is  an  inherent  difficulty  in  the  implementation  and  evaluation  of 
a decision  aiding  complex,  especially  when  realistic  operational  tasks 
are  Involved,  as  in  this  case.  The  ultimate  criterion  in  SIMTOS  is 
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performance  on  the  tactical  measures  collected  during  the  combat  session. 
Yet,  although  this  performance  cannot  be  aided  directly  because  it  is 
the  result  of  series  of  intermediate  decision  and  actions,  it  is  these 
activities  to  which  the  aid  must  be  linked.  Therefore,  the  analysis 
must  determine  the  extent  to  which  the  G-3's  information  processing 
behavior  was  influenced  by  the  aiding  complex.  Furthermore,  the  analysis 
must  define  the  actual  relationships  between  G-3  information  seeking, 
information  processing,  and  action  selection  behaviors  and  G-3  tactical 
performance. 

3.5.2  Aid  Utility  - Planning 

Regarding  the  estimate  of  the  situation  evaluation,  one  can  draw  two 
general  conclusions.  First  it  must  be  stated  that  during  the  planning 
phase  there  were  no  differences  between  the  two  groups  in  their  tactical 
scores.  Second,  relative  to  previous  studies  (e.g.,  Robins,  Buffardi 
and  Ryan,  1973),  planning  scores  were  lower. 

The  data  on  aid  usage  shows  that  the  estimate  aid  was  virtually  unused 
during  the  planning  sessions.  This  data  Indicated  that  only  three  of 
the  five  participants  in  the  aided  group  even  accessed  the  aid.  Further- 
more, the  total  aid  usage  constituted  only  a minute  fraction  of  all 
system  interactions.  Therefore,  during  planning  the  two  groups  behaved 
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in  very  similar  fashion,  and  one  would  expect  no  differences  in 
overall  performance. 

One  factor  which  certainly  impacted  aid  disuse  was  the  observed  fact 
that  the  study  participants  could,  on  the  basis  of  their  professional 
experience  alone,  perform  the  planning  task.  They  fell  far  short  of 
the  maximum  possible*  score,  but  this  was  probably  due  to  time  constraints. 
Thus  the  focus  of  activity  was  upon  the  paper  and  pencil  task — not  upon 
the  automated  tactical  operations  system. 

The  lack  of  estimate  of  the  situation  aid  utilization  can  be  summarized 
in  terms  of  the  man- computer  dialog  criteria. The  aid  took  the  form 
of  a list  of  frame  titles  containing  information  from  the  data  base  that 
was  considered  to  be  necessary  for  successful  completion  of  the  planning 
phase  either  in  terms  of  frame  content  (as  an  index  to  the  detailed  data 
required)  or  development  of  graphic  situation  overlays  (e.g.,  avenues 
of  approach,  key  terrain  features).  To  the  extent  that  these  fi.ame 
titles  were  not  perceived  to  be  relevant  to  the  planning  task,  it  might 
be  hypotheslzea  that  they  would  not  be  utilized.  This  Inference  is 
supported  by  the  actions  of  the  two  aided  individuals  categorized  as 
Passive.  Both  were  instructed  to  review  the  estimate  frames.  One 


Volume  1 of  this  report  develops  the  rationale  and  antecedents 
for  these  criteria. 
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participant  looked  at  the  >n  four  aid  frames  and  then  proceeded  to 
query  the  data  base  in  greater  detail.  All  subsequent  Interactions 
were  with  the  standard  data  base.  The  other  passive,  aided  participant 
did  not  access  the  aid  at  all.  This  constitutes  a dramatic  failure  of 
the  aid  in  terms  of  user  acceptance. 

Given  that  there  were  no  group  differences  in  tactical  performance,  were 
there  any  differences  in  information  processing? 

The  number  of  categories  queried  (sources  sought  measure)  was  the  same 
for  the  aided  and  unaided  participants.  This  suggests  that  there  was 
a consistency  in  the  types  of  information  that  the  participants  were 
interested  in. 


Information  acquisition,  since  the  aid  was  not  accessed,  reflects  the 
depth  of  information  query  into  the  data  structure.  The  aided  group, 
in  accordance  with  their  higher  ratio,  did  not  query  to  the  same  level 
of  detail  that  the  unaided  group  did.  This  led  to  the  conclusion  that, 
even  though  the  aid  was  not  perceived  as  directly  useful  to  the  planning 
task,  it  did  enable  the  aided  G-3’s  to  form  a representation  of  the 
data  base  (called  a data  base  description).  This,  in  turn,  led  to  less 
detailed  information  acquisition.  This  effect,  if  real,  should  be 
reflected  in  superior  system  and  data  base  usage  during  the  combat 


session. 
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The  error  ratio  measure  was  extremely  low  for  all  groups  (the  maximum  9 

number  of  system  of  errors  being  six  during-  the  planning  session) . « 

M 

Mention  must  be  made  of  the  distinction  between  an  error  In  system  m 

Wi 

usage,  which  appears  on  the  track  file,  and  an  error  In  Information  | 


selection  and  retrieval.  An  error  of  the  latter  category  Is  one  In 
which  the  user  operates  the  system  correctly  but  either  falls  to  find 
his  desired  Information  or  retrieves  what  would  appear  to  be  wha;  is 
wanted  but  in  fact  Is  not.  This  kind  of  system  error  is  not  displayed 
on  the  track  file,  but  heavily  Impacts  system  use  and  acceptance. 

To  summarize,  the  planning  session  results  indicate  that  the  aided 
group  neither  used  the  aid  to  any  significant  degree  nor  performed 
better  than  the  unaided  group.  By  using  the  aid,  we  mean  transferring 
the  data  frame  contents  to  the  primary  CRT.  The  proposed  alternative 
was  use  of  the  aid  to  gain  a specific  idea  of  data  base  contents  through 
.frame  titles.  There  was  no  direct  measure  of  this  form  of  use  except 
inferentially  via  the  information  usage  efficiency  measure. 

Aid  Utility  ~ Combat  Session 
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used  by  the  study  participants.  Not  only  the  system  but  the  aid  operated 
in  a dynamic  fashion.  The  task  required  the  G-3  to  Interact  closely 
and  knowledgeably  with  SIMTOS — not  with  some  external  response  sheet. 

The  aided  users  were  assisted  in  this  task  by  system  initiated  communi- 
cation, a key  element  of  effective  man-computer  dialog. 


The  estimate  of  the  situation  aid  for  the  combat  session  focused  upon 
two  t3Tpes  of  information.  One  was  key  information  in  the  data  base 
which  differed  from  that  in  the  planning  session.  The  other  was  in- 
telligence Infoxnnation  on  the  location  of  enemy  first  echelon  forces 
and  the  location  of  friendly  general  outpost  (GOP)  forces.  This  aid, 
if  used  in  conjunction  with  the  resource  allocatxon  aid,  enabled  the 
G-3  to  direct  his  fire  support  and  tactical  air  expenditures  in  an 
efficient  manner. 


Interestingly,  the  advantage  given  by  the  estimate  aid  is  best  indicated 
by  the  activities  of  the  participants  during  the  initial  static  portion 
of  the  combat  session.  During  this  period  the  unaided  group  set  up 
their  standing  requests  for  information  (SRIs) . These  lists  bore  a 
remarkable  congruence  to  the  estimate  aid  available  to  the  unaided 
group.  Thus,  the  two  groups  differed  little  in  terms  of  the  content 
of  the  Information  available  to  them  via  the  SRI  mechanism,  although 
again  there  were  large  individual  differences  in  the  number  of  SRIs 
(e.g.,  one  unaided  user  did  not  set  up  any). 
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What  was  different  was  the  saliency,  timeliness,  and  accessability  of 
the  information.  In  each  case,  the  aided  group  had  the  advantage. 
During  the  static  combat  phase  this  group  scheduled  five  missions, 
and  in  general  became  familiar  with  the  task  situation.  The  ability 
of  the  aided  group  to  use  rather  than  Initialize  the  system  gave  them 
a distinct  advantage  in  the  combat  play  phase.  The  aids  in  essence 
enabled  some  system  users  to  effectively  stop  or  slow  the  invasion. 


The  overall  performance  in  the  tactical  criteria  can  be  sutmnarlzed 
in  Figure  B-AO  showing  scenario  events  plotted  by  problem  update. 
Preplanned  mission  directives  were  scheduled  for  all  offensive  (enemy) 
units.  These  directives  were  ordered  executed  as  a function  of  geo- 
graphic penetration  into  the  defensive  section.  When  the  defensive 
(friendly)  player  slowed  or  stopped  these  lead  units,  the  total  in- 
vasion was  halted.  (Note  that  one  participant  was  able  to  do  Just 
that.)  In  Figure  B-Al  this  individual  was  plotted  separately.  When  his 
data  is  added  to  the  remainder  of  the  aided  group,  the  slight  advantage 
enjoyed  becomes  much  greater.  This  effect  is  observed  in  all  of  the 
tactical  performance  measures. 


When  the  data  from  this  G-3  is  analyzed  in  more  detail,  one  finds  he 
used  the  aid  earlier  in  the  problem  and  to  a much  greater  extent.  He, 
in  fact,  played  the  game  in  an  optimum  fashion. 
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All  tactical  performance  measures  were  highly  interconnected.  This 
can  be  beat  Illustrated  by  considering  weapon  expenditure  (Figures  B-79 
through  B-82)  and  enemy  force  attrition  (Figures  B-69  and  B-70).  Note 
that  for  the  unaided  group  the  slope  is  relatively  constant  across  up- 
dates for  these  measures.  This  is  not  the  case  for  the  aided  group. 

For  each  participant  in  this  group  there  is  a point  of  sharp  increase 
in  weapon  expenditure  which  is  mirrored  by  a corresponding  increase  in 
weapon  effectiveness  in  terms  of  impact  upon  the  enemy  attrition.  One 
finds  further  that  this  increase  in  slope  occurs  at  varying  points  in 
the  problem  for  different  G-3*s.  The  fact  that  it  occurs  at  all  is 
reflected  in  the  slight  overall  superiority  of  the  aided  group  during 
combat.  The  observation  that  one  individual  "discovers"  the  relation- 
ship during  the  static  portion  of  the  problem  accounts  for  his  over- 
whelming superiority.  For  him  the  task  was  completed  by  the  sixth 
update. 


A final  comment  regarding  the  tactical  performance  measures  is  that 
there  was  a convergence  toward  the  end  of  the  problem  between  the 
aided  and  unaided  groups.  The  aid  was  most  effective  in  the  early 
stages  of  the  problem  (i.e.,  during  the  static  pre-update  phase  and 
during  the  first  few  updates).  This  can  be  accounted  for  by  the  form 
of  the  estimate  aid.  Following  the  first  system  update*  the  CRT 
displaying  the  aid  contained  the  frame  titles  of  those  frames  included 
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in  the  aid  which  had  changed.  Since  this  information  was  also  dis- 
played on  the  line  printer,  the  advantage  of  the  aid  was  in  terms  of 
timeliness  of  presentation  and  direct  information  accessability.  As 
the  problem  progressed  and  units  either  reached  their  objectives  or 
were  halte  . the  number  of  data  base  changes  decreased.  Since  the  two 
groups  had  similar  Information  in  their  SRI/estimate  aid  files,  the 
Initial  advantage  enjoyed  by  the  aided  group  decreased. 

At  the  conclusion  of  the  planning  session,  all  participants  were  asked 
to  generate  a candidate  SRI  list.  This  could  have  been  used  to  generate 
an  individualized  estimate  aid  for  the  combat  session;  however,  time 
constraints  and  system  inflexibility  prevented  this  during  the  pre- 
liminary study.  These  lists  were  reviewed  for  context  against  the 
information  included  in  the  planning  and  combat  estimate  aids.  Although 
there  was  much  individual  variability  in  information  requirements, 
there  was  relatively  high  agreement  between  the  type  of  information 
the  participants  said  they  needed  and  what  was  available.  This  pro- 
vides some  validation  of  the  aid  content.  The  information  considered 
essential  by  an  individual  did  not  necessarily  correspond,  however,  to 
the  information  the  study  participant  actually  accessed.  This  finding 
is  in  agreement  with  other  studies  using  verbal  protocol  data  (e.g., 
Alden,  Heaton,  and  Henke,  1972).  This  area  is  a fruitful  one  for  addi- 
tional research  in  terms  of  developing  decision  aids  responsive  to 


individual  users. 
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The  data  on  usage  of  the  resource  allocation  task  aid  available  to  both 
groups  support  the  above  contentions.  Two  measures  were  used  to  assess 
the  effectiveness  of  the  resource  allocation  aid.  One  was  efficiency 
of  use  in  terms  of  missions  scheduled  by  times  the  aid  was  accessed. 

The  aided  group  was  more  efficient  suggesting  they  had  the  target  co- 
ordinates extracted  and  were  more  facile  in  using  the  system.  A second 
measure  was  actual  time  in  the  aid  loop;  again  the  aided  group  was 
superior.  A conclusion  one  draws  from  this  is  that  le  estimate  aid 
enabled  the  aided  group  to  extract  the  data  necessary  to  schedule  its 
fire  missions  and  then  execute  these  missions  in  a more  efficient  and 
timely  fashion. 

The  analysis  of  the  other  information  processing  measures  recorded 
during  the  combat  session  indicated  essentially  the  same  thir.g  as  in 
planning.  Where  use  of  the  estimate  aid  impacted  these  tp  asur-  >,  such 
as  in  redundancy  (accessing  the  same  frame  repeatedly)  or  information 
usage  efficiency  (data  frames  retrieved  versus  number  of  fr  imes  queried) , 
the  aided  group  tended  to  have  higher  ratios.  It  must  be  noted,  however, 
that  redundancy  in  this  session  is  related  to  Importance  of  the  infor- 
mation. The  more  critical  the  information  is  perceived  to  be  to  the 
scenario,  the  more  likely  it  is  to  be  redundantly  retriev'd. 
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It  was  hypothesized  that,  due  to  the  homogeneity  of  the  population  from 
which  our  sample  of  participants  was  to  be  drawn,  only  some  of  the 
possible  decision  styles  from  the  DSMI  would  be  repreiented.  The 
participant  background  data  highlights  the  homogeneity  of  the  sample. 
Although  five  of  the  eight  decision  styles  wei-  i'our.d,  two  of  the  five 
contained  70?  of  the  participants.  (See  Table  'i-  4.) 

The  small  size  of  the  evaluative  sample  is  reduced  even  further  when 
participants  are  grouped  by  style.  Again,  any  definitive  conclusions 
about  style  and  performance  are  precluded  In  order  to  determine  any 
trends  in  the  data,  the  tactical  and  information  processing  measures 
were  examined  according  to  single  style  dimension. 

Consistent  differences  were  found  during  planning  in  the  comparisons 
between  the  active  and  passive  and  betwe'in  the  logical  and  intuitive 
participants  on  sources  sought  measure,  on  redundancy  and  on  information 
acquisition.  As  would  be  predicted,  th(  active  decision  makers  search 
more  information  categories  (seek  more  sources)  than  the  passive. 

The  active  individuals  are  also  more  redundant  and  have  a higher  infor- 
mation acquisition  rr*.  i than  the  passives. 

As  indicated  in  the  results,  there  are  two  ways  in  which  the  information 
acquisition  ratio  v"  uld  be  high;  through  aid  usage  or  by  depth  of  the 
search  into  the  data  base  structure.  Since  the  aid  was  not  utilized 
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during  planning,  the  higher  ratio  indicates  that  the  active  individuals 
were  not  seeking  the  level  of  detail  that  the  passive  individuals  were. 

The  intuitive  participants  sought  more  .sources,  were  more  redundant, 
and  also  had  a higher  information  acquisition  ratio  than  the  logical 
participants.  The  intuitive  decision  maker  would  need  to  search  more 
categories  to  get  an  overall  estimate  of  the  situation.  In  doing  so, 
more  interrelationships  might  become  apparent  causing  him  to  recheck 
some  of  the  information.  Also»  the  intuitive  Individual  needs  less 
detail.  These  observations  reflect  the  organization  of  the  data  base — 
logical  and  sequential. 

3.5.5  Conclusions 


The  evaluation  presented  in  this  report  was  preliminary  in  nature.  Due 
to  the  small  number  of  participants  and  high  individual  performance 
variability,  the  data  was  subjectively  interpreted  in  an  effort  to 
identify  meaningful  performance  trends.  This  interpretation  led  to  the 
conclusions  described  below  concerning  tne  estimate  of  the  situation 
aid  during  planning  and  combat  and  the  resource  allocation  aid  during 


combat . 
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The  planning  task  was  oriented  toward  completion  of  a series  of  response 
sheets  describing  the  defensive  operation.  This  required  little  system 
Interaction  for  a knowledgeable  and  experienced  operations  offlcar. 

When  the  constraints  of  time  became  apparent  to  the  study  participants, 
all  system  use  decreased.  This  implies  that  not  only  was  the  aid  not 
perceived  as  useful,  but  the  system  as  a whole  was  not  perceived  as 
relevant  to  the  planning  task.  Future  studies  of  decision  making  In 
SIMlOS  must  make  the  planning  phase  more  relevant  to  the  plan  executed 
during  the  combat  phase. 

During  the  combat  session,  the  estimate  of  the  situation  aid  was  used 
to  a much  greater  extent  than  during  planning.  Also,  the  r-^source 
allocation  aid  was  used  by  all  participants.  The  trends  of  the  data 
Indicated  that  the  sooner  the  role(s)  of  the  ald(s)  were  perceived  by 
the  system  users,  the  more  effective  their  performance.  The  man/computer 
dialog  again  played  a key  role  in  aid  utility.  The  factors  of  aid  per- 
ceived usefulness,  flexibility,  accessability,  timeliness  and  inter- 
action between  the  aids  led  to  the  aided  group's  performing  In  a gen- 
erally superior  fashion. 


This  is  by  no  means  an  indication  that  the  aids  are  in  a polished  form. 
Rather  the  content  and  form  of  the  aids  were  generally  acceptable  but 
need  refinement  so  that  the  initial  gains  can  be  exploited.  The 
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responsive  capability  of  each  user  must  be  further  enhanced.  Also, 
the  aids  must  be  more  oriented  to  the  primary  G-3  task  requirements. 
One  can  conclude  from  the  trends  that  we  are  on  the  correct  track. 
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EXHIBIT  1 


Situation 


During  the  past  three  months,  the  political  situation  in  Europe  has 
deteriorated  rapidly.  Diplomatic  relations  have  been  broken  off  between 
Circle  Trigon  and  Western  governments,  including  the  U. S.  There  has  been  con- 
siderable military  activity  along  the  entire  West  German-Circle  Trigon  Border 
during  recent  weeks.  This  activity  is  being  "covered"  under  the  pretext  of 
conducting  annual  fall  maneuvers. 


To  counter  the  military  threat  of  the  Circle  Trigon  build-up,  the  50th 
U.S,  Arny  has  been  airlifted  to  Germany  to  supplement  NATO  forces.  The  50th 
Army  is  now  in  assembly  areas  along  the  Circle  Trigon  Border,  with  the  1st 
and  2nd  Corps  on  the  north  and  the  5d  Corps  in  the  south. 

The  20  Inf.  Div.  (Mech)  is  a reserve  unit,  recently  mobilized.  It  is 
within  the  Corps  and  is  now  on  combat  alert  in  an  assembly  area  in  West 
Germany.  The  Corps  has  been  directed  by  50th  Army  to  prepare  to  defend 
the  KASSEL  (NB5585),  ERFURT  (PBif548),  SCHWEINFURT  (NA884-5)  triangle. 

Assume  that  you  are  the  G-5  of  the  20  Mech  Div.  Your  role  will  be: 

a.  To  complete  portions  of  the  defensive  planning  to  accomplish 
the  20  Mech  Div.  mission  as  specified  in  5d  Corps  OPORD  65,  and 

b.  To  supervise  and  execute  a defense  of  the  division  sector  during 
' an  attack  from  the  east. 


No  contingency  plans  are  available,  OPLANS  are  badly  out  of  date. 
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(classification) 


3D  CORPS 
KRONACH  (PA6668) 
11J-2100SEP74 


OPORD  63 

REFERENCE;  Map,  HOF-PLAUEN,  1:50,000;  GERMANY,  1:250,000 
TASK  ORGANIZATION; 

1.  SITUATION: 

a.  Enemy  Forces;  Annex  A,  Intelligence 

b.  Fri--'ndly  Forces: 

(1)  1st  Corps  and  2nd  Corps  prepare  defensive  positions  on  north 
(left)  flank  of  30th  Arnor, 

(2)  3d  Corps  prepares  defensive  positions  in  sector  from  BERGA 
(TS9926)  to  HAZLAU  (URO760) 

(3)  Elements  of  9th  AF  provide  Tac  Air  support 

c.  Attachments  and  Detachments:  Task  Organization 

2.  MISSION; 

3d  Corps  to  move  immediately  to  defensive  positions  and  in  event  of 
attack  defend  in  sector  for  up  to  30  days  to  permit  build-up  of  NATO  forces. 

3.  EXECUTION; 

a.  Concept  of  Operation:  .mnex  B,  Operation  Overlay 

(1)  Maneuver 

3d  Corps  to  establish  defense  in  sector  with  the  5?th  Inf.  Div. 
(Mech)  on  the  north,  20th  Inf.  Div.  (Mech)  in  the  center  and 
74th  Inf.  Div.  (Mech)  in  the  south.  The  56th  Armor  Div.,  Corps 
reserve  vie  NORDHALBEN  (PA7883).  Line  divisions  establish  GOP 
NuT  I5060OSEP74. 

(2)  Fires 

Priority  of  arty  and  tac  air  support  to  57th  Mech.  Div.,  20th 
Mech  Div.,  and  74th  Mech.  Div.  in  that  order,  and  to  Corps 
counter-attacking  forces  on  commitment.  Annex  C,  Fire  Support. 

(CLASSIFICATION) 
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b. 


d. 


e. 


20  Mech.  Olv. 

(1)  Prepare  to  defend  in  sector. 

(2)  Prevent  enemy  from  penetrating  west  of  hills  729  (PA8678), 

795  (PA8873),  and  726  (PA9066). 

(3)  Establish  GOP. 

71^  Mech  Div. 

(1)  Prepare  to  delay  in  sector. 

(2)  Canalise  enemy  along  SELB(TR9562) 

(3)  Establish  GOP. 

57th  Mech  Div. 

(1)  Prepare  to  defend  in  sector. 

(2)  Prevent  enemy  from  penetrating  west  of  GORKWITZ  (PB9798)  GORITZ 
(PA9690)  Autobahn. 

(3)  Establish  GOP, 

Arty: 

(1) 


(2) 


FA; 

(a) 

61  Arty  Gp; 

GSR  20  Mech.  Div 

(b) 

62  Arty  Gp; 

GSR  57  Mech.  Div 

(c) 

63  Arty  Gp; 

GSR  74  Mech.  Div 

(d) 

401  Arty  Gp: 

GS 

(e) 

2-631  (155) 

(SP)  Arty;  Atch  i 

ADA: 

(a) 

1-^39  Arty: 

Atch  20  Mech  Div 

(b) 

2-439  Arty: 

GSR  74  Mech  Div 

(c) 

3-439  Arty; 

GSR  57  Mech  Div 

f. 

g> 


301  Cml  Bn  (Smoke  Genr);  Atch  7^  Mech  Div 
51  Engr  Bde; 

(1)  Support  defensive  operations  employing  56th  Engr  Bn  (CBT)  on 
the  north,  ^kth  Engr  Bn  (CBT)  center,  and  55th  Engr  Bn  (CBT) 
in  the  south. 
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(CLASSIFICATION) 

(^)  Priority  of  effort  in  order,  construction  of  blocking  positions 
preparation  of  obstacles,  and  road  maintenance. 

h.  Aviation: 

(1)  129  Avn  Bn:  DS  20  Mech  Div 

(2)  130  Avn  Bn:  DS  57  Mech  Div 

(3)  131  Avn  Bn:  DS  Jh  Mech  Div 

i.  SUPCOM 

(1)  Remain  in  present  position 

j.  Res: 

(1)  56th  Armd  Div 

(a)  Be  prepared  to  ctr-atk  in  Corps  north  flank  area. 

k.  Coordinating  Instructions: 

(1)  Units  will  construct  obstacles  as  required  to  cause  maximum 
restriction  to  enemy  movement.  Roads  or  other  high-speed 
avenues  of  approach  will  be  blocked  in  depth.  Barriers  will 
canalize  enemy  attack  into  killing  area. 

(2)  Destruction  of  population  centers  and  communications,  trans- 
portation, utilities,  mining,  factories,  and  port  facilities 
will  be  minimized. 

(3)  Use  of  chemical  contaminants  requires  specific  Army  approval. 

(4)  Any  destruction  that  may  have  strategic  impact  will  require 
Army  approval  prior  to  execution. 

(5)  Barrier  and  denial  operations  must  not  unduly  restrict  future 
Army  operations  particularly  to  the  north. 

(6)  Gaps  and  lanes  in  Army  directed  barriers  behind  FEBA  to  be 
closed  only  on  Army  order. 

(7)  Nuisance  mines  will  not  be  authorized. 

(8)  Barrier  construction  may  be  initiated  without  further  orders. 

(9)  Nuclear  expenditures  are  not  authorized. 

4.  SERVICE  SUPPORT 

admin/log  plan  63; 

5.  COMMAND  AND  SIGNAL: 


(classification) 
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(CLASSIFICATION) 

a.  Signal 

(1)  SOI  Index  1-3 

(2)  Annex^  E,  Signal 

b.  Conmand:  Corps  Tac  CP  with  7^t^h  Dlv. 

Acknowledge. 

Annexes:  A- Intelligence  (omitted) 

B-Operatlon  Overlay 
C-Flre  Support  (omitted) 

D-Englneer  (omitted) 

E-Slgnal  (omitted) 

Distribution;  A 

2nd  Corps 

OFFICIAL 

/s/farley 

G5 


MALONE 

MG 
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EXHIBIT  5 

Planning  Activities  (Morning  Session) 

Your  planning  sequence  will  be  divided  into  two  phases: 

• Recommendation  of  a Course  of  Action 

• Development  of  the  Operations  Plan 

Your  staff  aid  will  provide  you  with  the  "commander's  guidance"  and  your 
specific  task  requirements  at  the  beginning  of  Phase  I. 

When  you  have  completed  your  Phase  I planning  tasks,  contact  the  exper- 
imenter via  the  telephone  (press  JR),  He  will  then  provide  you  with  the 
"commander's  guidance"  and  your  specific  task  requirements  for  Phase  II. 

When  you  have  completed  your  Phase  II  planning  tasks,  contact  the  exper- 
imenter via  the  telephone  (?R).  You  will  then  have  a break  before  parti- 
cipating in  the  combat  session.  You  will  have  a maximum  of  one  hour  for  each 
of  these  phases. 

Administrative  Note 

If  you  have  to  leave  your  work  station  any  time  during  today's  problem, 
please  contact  the  experimenter  via  the  telephone  as  you  leave,  and  when  you 
get  back.  In  this  way,  our  time  records  will  show  only  the  time  you  were 
actually  working  on  the  problem. 

Date/Time 

For  purposes  of  the  study,  assume  that  today's  date  is  lb-  September  1972 
and  it  is  now  2100  hours. 
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EXHIBIT  5 


20  INF  DIV  (MECH) 
142100SEPTJ+ 


TO;  G3 
FRCM:  CMDR 

SUBJECT:  Reconmendation  of  a Course  of  Action 

You  are  requested  to  prepare  recommendations  to  accomplish  the  20  Inf.  Div. 
Mission  as  indicated  in  OPORD  63*  Base  your  work  on  the  following  consider- 
ations; 

1.  Form  of  Defense 

Considerations  of  terrain  and  relative  mobility  are  most  significant.  The 
rugged  terrain  along  the  Saale  River  (QA0l87-QA09n^3 ) provides  good  cover  and 
concealment,  excellent  observation  of  the  river  valley  and  good  to  excellent 
fields  of  fire.  Therefore,  division  planning  will  proceed  on  the  basis  of  an 
area  defense. 

2.  Mission 


»-*' 
W-  i 
^ * 


(a)  Our  mission  is  to  defend  along  the  Saale  River  line  in  sector. 

(b)  We  must  employ  a general  outpost.  The  Corps  Commander  has  not 
specified  the  location  of  a GOP.  Organize  avid  locate  the  GOP  with  sufficient 
strength  to  provide  at  least  24  hours  for  us  to  prepare  blocking  positions. 


5. 


Organization  of  Defense  Sector 


We  will  organize  our  defense  sector  and  conduct  the  defense  primarily  to 
retain  terrain  in  the  forward  defense  area  taking  maximum  advantage  of  the 
Saale  River  obstacle.  The  ridge  formed  by  Hills  715  (PA8678),  79^  (l*A8875)> 
and  726  (PA9066)  must  be  retained  to  support  corps  counterattack  operations. 
The  division  reserve  must  be  located  where  it  can  block  penetrations,  counter- 
attack to  regain  terrain,  and  add  depth  to  the  defense. 

4.  Course  of  Action 

(a)  In  developing  a course  of  action  consider  retention  of  key  terrain 
and  the  obstacle  value  of  HOF  (QAo878). 
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(b)  Your  recommended  course  of  action  should  consider  the  enemy  capa- 
bility of  ifacking  in  the  20th  Div  Sector  with  two  or  three  divisions  sup- 
ported by  artillery  and  air.  Tactical  infiltration  may  be  employed.  It  is 
assumed  tnat  nuclear  weapons  will  not  be  used. 

5 . Dea aline 

Your  recommendation  is  reqd  nit  I5OOOISEP. 

SMITH 

Commander 
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EXHIBIT  6 

INSTRUCTIONS: 

A.  On  response  Sheet  #1.  complete  the  following: 

1.  Allocation  of  CBT  Power  to  Echelons  of  Defense 

a.  GOP  Force  by  Unit 

b.  FDA  Force  by  Un:  t 

c.  Reserve  Force  by  Unit 

2.  Specific  type  of  resistance  by  eath  echelon  of  defense  (delay, 
screen,  defend). 

B,  On  1:50,000  SITMAP  overlay,  indicate  location  of: 

1.  GOPL 

2.  COP  coordination  point 

You  will  have  one  hour  to  complete  the  above,  contact  aide  via 
the  telephone  (7R)  at  that  time. 


RESPONSE  SHEET  #1 

ALLOCATION  OF  COMBAT  POWER  TO  ECHELONS  OF  DEFENSE 

Column  (l)  MISSION:  Enter  one  of  the  following:  delay,  defend,  screen, 

reconnoiter,  counterattack. 

Coltmm  (2)  SECTOR:  Indicate  the  portion  of  the  20  Mech  Div  sector  in  which 

the  major  unit  will  operate.  Enter  reserve,  rear  area  security,  or 
north,  center,  south  m FDA. 

Column  (3)  AVENUE:  Enter  Avenue  or  Avenues  of  Approach  against  which  the 

unit  will  operate  (A,  B,  C,  D,  E)  as  appropriate. 

Column  (4)  SUBORDINATE  UNITS:  Enter  all  maneuver  and  support  units  allocated 

to  the  Bde  headquarters,  and  indicate  GOP  composition  by  an  asterisk 
(*).  Cross-attach  company  sized  units  if  you  wish.  If  unit  is  in 
support  role,  indicate  GS,  GS  Reinf.,  or  DS. 

MAJOR  UNIT 


1 BDE 


(1) 

MISSION 


(2) 

SECTOR 


(5) 

AVEI^(S) 


(M 

SUBORD  UNITS 


EXHIBIT  7 


INSTRUCTIONS: 

1.  On  Response  Sheet  write  your  recommended  Div.  Task  organization.  In- 
dicate type  of  relationship  to  BDES^  div.  troop  and  divarty:  (attached, 
DS,  GS  REINF,  or  GS). 

2.  On  Response  Sheet  fj,  write  your  reconmended  maneuver  plan  and  mission 
directives  to  subordinate  units. 

5.  Indicate  on  the  1:50,000  SITMAP  overlay  the  location  of  the  following: 

a.  BDE  lateral  and  rear  boundaries 

b.  BDE  coordinating  points 

c.  Visualized  FDA  battalion  location 

d.  Reserve  force  location 

e.  Visualized  allowable  enemy  battalion  penetrations,  and 

f.  Division  directed  blocking  positions 

4.  You  will  have  one  hour  to  complete  the  above  task,  please  contact  your 
aide  via  the  telephone  (7R)  at  that  time. 


RESPONSE  SHEET  #2 


EC-D5 

20  Mech  Div 
West  Germany 
150200SEP71*. 

TASK  ORGANIZATION 

List  ccmbat  and  combat  support  units  in  the  specific  task  organization, 
which  you  want  to  recommend.  Specify  allocation  of  mech.  bns.  armd  bns. 
artillery,  air  defense  artillery,  armd  cav.  squadron,  and  engineers . Cross- 
attach  companies  if  you  wish  to. 

1st  Bde  2nd  Bde 


5d  Bde 


EXHIBIT  8 EC-D5 

RESPONSE  SHEET  #3  150200SEP74 

CONCEPT  OF  MANEUVER  AND  MISSIONS  TO  SUBORDINATE  UNITS 

Write  out  your  recommended  concept  of  the  operation  and  your  mission 
directives  to  20  Mech  Dlv  subordinate  units  under  Paragraph  3#  below.  Each 
subparagraph  is  preceded  with  a set  of  instructions.  Please  follow  these 
instructions  in  completing  your  responses. 

1.  SITUATION 

a.  Enemy  Forces.  Annex  A,  Intelligence 

b.  Friendly  Forces. 

(1)  3<J  Corps  defends  immediately  in  sector  with  37  Mech  Div  on  the 
north,  20th  Mech  Div  in  the  center,  and  7^th  Mech  Div  on  the 
south.  56th  Arrad  Div  and  26th  (UK)  Armd  Div  are  Corps  Reserve. 

(2)  Elements  of  9th  TAF  support  3d  Corps. 

(3)  6lst  Arty  Gp  GSR  20th  Mech  Div. 

2.  MISSION 

Division  defends  in  sector  immediately  from  (QAOO86)  to  (Ql087^)»  allows 
no  penetration  west  of  Hills  7I5  (PA8678),  7^(PA88T5),  ani  726(PA9066); 
and  concurrently  occupies  general  outpost. 

3.  EXECIT  m 

a.  Concept  of  the  Operat  .on 

The  concept  of  operation  is  divided  into  two  subparagraphs:  one 

describing  the  scheme  of  maneuver  and  the  second  covering  the  plan 
of  fire  support. 

The  first  subparagraph  gives  the  concept  of  operation.  This  is  a 
statement  of  the  commander's  tactical  plan,  to  include  the  scheme  of 
maneuver  and  plan  of  fire  support.  It  is  informative  rather  than 
directive.  It  may  also  provide  the  commander's  visualization  of  the 
conduct  of  the  operation  and  a clarification  of  its  purpose.  Although 
brief,  it  is  stated  in  sufficient  detail  to  insure  appropriate  action 
by  subordinates  in  the  absence  of  additional  specific  instruction. 

If  the  operation  is  phased,  each  paragraph  should  reflect  same.  The 
scheme  of  maneuver  covers  employment  of  major  maneuver  units  and  is 
derived  primarily  from  the  commander's  decision. 


(l)  Maneuver 


The  plan  of  fire  support  in  the  second  subparagraph  steins  from  the 
commander's  decision  and  from  staff  planning.  It  includes  whether  a pre- 
paration is  to  be  fired  and,  if  so,  its  duration  and  priority  of  fires. 


(2)  Fires 
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In  the  next  subparagraphs,  give  the  specific  task  to  be  accomplished  by 
each  of  the  major  elements  of  the  command. 

(3)  1 Bde: 


(4)  2 Bde: 


(5)  3 Bde 
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^1  (6)  Artillery.  The  artillery  subparagraph  is  divided  into  two  parts:  the 

^|j  first  covers  field  artillery  and  the  second  covers  air  defense  artillery, 

^i'  In  listing  artillery,  the  organic  and  attached  units  are  listed  in  num- 

erlcal  sequence  (regimental  numbers),  beginning  with  the  lowest  numbered 
unit.  As  minimum,  the  artillery  subparagraph  Includes  the  artillery 
te|  organization  for  combat. 
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Other  Combat  Elements.  Other  elements  providing  combat  support  (e.g., 
armored  carrier  units  or  engineer  units  performing  combat  support  engineer 
tasks,  as  applicable).  These  elements  are  listed  in  alphabetical  sequence 
by  branch.  Normal  service  missions  are  not  Included.  It  is  not  necessary 
to  list  all  the  units  in  the  command,  nor  is  it  required  to  give  in- 
structions for  the  total  employment  of  a particular  unit.  For  example, 
instructions  to  an  engineer  unit  concern  only  the  combat  support  portion 
of  the  unit's  mission. 


(a)  Engr; 


(b)  Reserve; 


Coordinating  Instructions.  The  last  subparagraph  of  paragraph  5 is 
entitled  "Coordinating  Instructions"  and  contains  details  of  coordination 
and  control  applicable  to  two  or  mor-i elements  of  the  command.  Troop 
safety  measures  appropriate  to  the  nuclear  battlefield  may  be  shown  here. 
Restrictions  on  use  of  nuclear  weapons  may  be  included.  Priorities  and 
necessary  coordination  for  use  of  the  airspace  above  the  battlefield  are 
shown  here. 


EXHIBIT  9 
DEFENSIVE  SCENARIO 

COMBAT  SESSION  BRIEFING 


SITUATION 


a.  You  are  asked  to  continue  in  the  role  of  G-5  of  the  20th  Inf  Div 
(Mech ) . 

b.  The  Division  Commander  has  considered  all  defensive  planning  recom- 
mendations. The  resulting  20  Mech  Div  OPLAN  37  was  approved  by 
Corps.  Therefore,  your  assignment  is  to  execute  20  Mech  Div  OPORD 
37^  a copy  of  which  is  attached. 

c.  All  units  have  now  moved  to  defensive  positions,  as  portrayed  on 
the  operations  Overlay  for  OPORD  37. 

YOUR  TASKS 

In  keeping  with  the  mission  of  the  20th  Div  you  are  to  do  everything  you 
can  to  delay  the  aggressor  and  to  defend  your  sector. 

You  have  already  organized  your  forces  and  positioned  them  for  the  defense, 
when  combat  starts  you  will  be  advised  every  ten  minutes  of  developments.  You 
will  be  able  to  follow  specific  situations  if  you  establish  Standing  Requests 
for  Information  (SRi).  If  some  of  your  units  are  in  trouble,  you  may  wish  to 
reinforce  them  by  cross -attachments,  at  the  company  and  battalion  levels,  by 
calling  in  tactical  air  strikes,  or  by  requesting  artillery  support.  You  may 
also  access  the  data  base,  as  you  did  earlier,  in  order  to  extract  particular 
items  of  information. 

We  realize  that  a Division  G-3  would  not  be  expected  to  perform  some  of 
the  tasks  that  we  will  ask  you  to  do  this  afternoon.  These  tasks  will  include 
calling  in  artillery  fires  and  air  strikes  to  support  your  maneuver  units, 
normally  a fire  support  coordinator  function.  However,  we  need  to  know  when 
such  support  would  be  given  and  how  much  support  would  realistically  be  given. 
Based  on  the  responses  given  by  persons  such  as  yourself,  we  shall  be  able  to 
program  the  computer  to  handle  the  fire  support  and  tac  air  requirements  in  a 
realistic  manner,  so  that  future  consultants  can  proceed  with  their  normal 
decision  making  tasks. 

The  computer  will  not  "know"  when  and  how  to  use  the  simulated  fire 
power  unless  we  tell  it.  We  prefer  that  such  judgments  be  baf^ed  on  data 
provided  by  experienced  military  officers  such  as  yourself. 

Your  specific  goals  are  to  hold  terrain,  inflict  maximum  personnel  and 
materiel  losses  on  the  enenqr,  and  minimize  such  losses  for  your  forces. 


k.  TASK  ORGANIZATION  AND  MISSIONS 


At  tl;e  start  of  combat,  all  maneuver  and  support  units  will  be  organized 
and  will  receive  initial  mission  directives  in  accordance  with  20  Inf  Div 
OPORD  37*  Further  commands  to  these  units  or  to  specific  artillery  and  air 
units  will  be  initiated  by  you,  using  the  CRT. 

5.  TIME 

After  you  have  been  instructed  in  how  to  operate  the  CRT  keyboard  the 
exercise  will  begin.  The  exercise  start  time/date  will  be  I5I2VOSEP.  The 
start  of  the  exercise  will  be  signalled  by  the  general  index  automatically 
appearing  on  your  CRT. 


EXHIBIT  10 

(CLASSIFICATION) 

(No  change  from  verbal  orders) 

EC-E5 

Copy  2 of  12  copies 
20  MECH  DIV 

CULMITZ  (011159)  GERMANY 
150300SEPT4 

OPORD  57 

REFERENCE;  A - Map,  (Germany  1:50,000,  HOF  - PLAUEN) 

B - Map  (Central  Germany  - 1:250,000) 

C - Overlay  (2O  Mech  Div  Area  of  Operations) 


TASK  ORGANIZATION 

1st  Bde  2d  Bde 


1-66  Mech 
I-67  Mech 
1-68  Mech 
1-1  Armd 
1-1^5  FA(DS) 
b/1-1»-59  ADA 
A/20  Engr  (DS) 


1-69  Mech 
1-70  Mech 
1-71  Mech 
1-2  Aimd 
1-46  FA(DS) 
b/20  Engr  (DS) 


5d  Bde 


DIV  TRP 


1-72  Mech 
I-3  Armor 
1-21  Cav 


20  Engr  (-) 
20  AVN 
20  SIG 


1-47  FA  Bn-Grp  20  MI’  Co 

1- 47  FA 

2- 631  FA  (l55-SP)(reioains  attached) 

A/l-439 

C/20  Engr  (DS)  DISCOM 


DIVARTY 


20  Admin  Co 
20  Maint 
20  Med 

20  sar 


1-48  FA 
1-49  FA 
1-439  ADA  (-) 


(CLASSIFICATION) 


(CLASSIFICATION 


1.  SITUATION 

a.  Enemy  Forces 

(1)  The  Agressor  l6  Combined  Army  is  expected  to  attack  through  the 
Hof  Gap  with  probable  objective  to  secure  the  rail  heads  vie 
COBURG  (PAlfOTO). 

(2)  Concentrations  of  enemy  forces  suggest  that  main  attack  may  occur 
in  20  Mech  Div  sector  along  Avenue  of  Approach  (Alpha).  See  over- 
lay. 

(3)  Secondary  attacks  can  be  expected  along  Avenues  of  Approach 
(Bravo),  (Charlie),  and  (Delta).  See  overlay. 

(k)  Enemy  units  opposing  20  Mech  Div  are  approximately  95  percent 

to/e. 

(5)  Annex  A (Intelligence). 

b.  Friendly  Forces 

(l)  3^  (us)  Corps  prepares  to  conduct  mobile  defense  in  sector  NLT 

I5040OSEP  with  57  Mech  Div  in  the  north,  20  Mech  Div  in  the  center, 
and  7^  Mech  Div  in  the  south.  56  Armd  Div  is  Corps  reserve  with 
priority  of  emplo3nnent  to  7^  Mech  Div.  kOlst  Arty  Gp  protects  in 
priority  Corps:  FDA,  Corps  reserve,  corps  command  post. 

(2)  26  (UK)  Armd  Div  supports  3d  (US)  Corps. 

(3)  Elements  of  9th  Tactical  Air  Force  support  3^  (US)  Corps. 

(4)  6lst  FA  Grp  GSR  20th  Mech  Div. 

c.  Attachments  and  Detachments.  Task  Organization 

2.  MISSION 

20  Mech  Div  defends  NLT  150400SEP  from  (120270)  to  (200120),  retains  Hills 
715  (PA8678),  79^(PA8873)  and  726(PA9066)  and  delays  Agressor  east  of  the  Saale 
River  (190180)FEBA  for  24  hours. 

3.  EXECUTION 

a.  Concept  of  Operation  (Annex  B Operation  overlays) 

(1)  Maneuver.  20th  Mech  Div  conducts  area  defense  of  the  Saale  River 
from  (115275)  to  (200130).  1st  Bde  defends  in  the  north.  2d  Bde 
defends  in  the  south.  3U  Bde,  div  res,  prepared  to  counter- 
attack to  restore  the  FDA,  priority  to  sector  of  1st  Bde.  3d 
Bde  establishes  div  GOP  of  two  battalions  to  obtain  24-hour  delay. 

(CLASSIFICATION) 
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(CLASSIFICATION) 

(2)  Fires.  Priority  of  artillery  and  close  air  support  first  to  the 
GOP,  to  the  1st  Bde  upon  withdrawal  of  the  GOP,  to  the  div  res 
when  conmited. 

b.  1st  Bde; 

(1)  Defends  in  Sector 

(2)  Prepare  in  priority:  blocking  position  1,  2,  and  3. 

c.  2nd  Bde; 

(1)  Defends  in  Sector 

(2)  Prepares  in  priority;  blocking  positions  4,  5»  6. 

d.  3d  Bde; 

(1)  Establishes  GOP  inunediately  with  two  battalion-sized  task  force; 
delays  eneny  forward  of  FEBA  for  24  hours. 

e.  ARTY; 

(1)  FA; 

(a)  1-43  FA;  DS  1st  Bde 

(b)  1-46  FA;  DS  2d  Bde 

(c)  1-47  FA;  Form  1-4J  FA  Bn-Gp;  after  group  ceases  GSR  1-46 
FA;  DS  Bde  on  conroitment. 

(d)  1-47  FA  Bn-Gp; 

1- 47  FA 

2- 651  FA 

Attached  Bde;  attachment  and  Bn-Gp  cease  on  withdrawal  of 
GOP. 

(e)  1-48  FA;  GSR  1-47  FA  Bn-Gp;  on  withdrawal  GOP,  GSR  1-43  FA 

(f)  1-49  FA;  GS 

(g)  2-631  FA  Atch  1-^7  FA  Bn-Gp;  after  group  ceases  GSR  1-46  FA 

(2)  ADA: 

(a)  1-439  ADA  (-);  Protect  in  priority;  division  reserve, 
division  command  post,  DISCOM. 

(b)  A-439  ADA;  atchd  ^d  Bde;  on  withdrawal  of  GOP;  atchd  2d  Bde 

(c)  B/1-439  ADA;  atchd  1st  Bde 
(5)  Annex  C,  Fire  Support. 

(CLASSIFICATION) 


(CLASSIFICATION) 

f.  20  Mech  Div  Av»iation:  GS;  support  Bde  with  A.20  Avn  until  with- 

drawal GOP 

g.  20  Mech  Div  Engr:  (-):  GS;  priority  to  the  reserve.  On  withdrawal 

GOP,  C/20  Engr:  ^DS  3d  Bde 

(1)  20  Engr 

(2)  Annex  D (Engineer) 

h.  Reserve;  (-) 

(1)  Battalion  Task  Force  of  3d  Bde  until  withdrawal  of  GOP. 

(2)  3<1  Bde  after  withdrawal  through  FEBA. 

(3)  Prepares  to  execute  Div  counterattacks,  priority  to  1st  Bde 
sector. 

(4)  Prepare  to  release  one  company  for  rear  area  security. 

i.  Coordinating  Instructions; 

(1)  Bdes  in  FDA  support  GOP  withdrawal. 

(2)  1st  and  2d  Bdes  destroy  Saale  River  Bridges  in  sector  upon  with" 
drawal  of  GOP. 

(3)  Priority  of  road  movement  to  GOP  force  on  withdrawal  through 
sector. 

k.  SERVICE  SUPPORT;  ANNEX  E 

DISCOM  operational  in  vicinity  SCHWARZENBACK  (PA8T74)  NLT  I5OIOOSEP. 

5.  COMMAND  AND  SIGNAL;  ANNEX  F 

Div  CP  opens  in  vicinity  of  CULMITZ  (OIII39)  I5030OSEP. 
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Annexes  A - Intelligence  (omitted) 
B - Operation  Overlays 


EXHIBIT  15 

DECISION  AIDED  SIMTOS 


Thank  you  for  your  participation  as  a consultant  in  this  effort  to  develop 
automated  decision  support  systems  for  Army  Officers.  We  know  that  it  has  beeti 
a strenuous  day,  but  we  would  appreciate  a few  more  minuties  of  your  time.  Ypur 
answer  to  the  following  questions  can  help  us  refine  our  research  and  fulfill 
our  objective  of  producing  military  information  systems  that  are  responsive  to 
your  needs.  This  information,  as  well  as  the  rest  of  today's  materials,  is 
confidential. 

Personal  Data 

Name Present  Rank 

Age  . Years  of  Active  Military  Service  

Present  Position  


Military  Experience 

1.  Please  summarize  your  military  experience  in  chronological  order  in  the 
spaces  provided.  Please  emphasize  any  previous  G-J  experience. 

YEAR  UNIT  TYPE  POSITION  HELD  DURATION  LOCATION  COMBAT 

(Co.  Bn.  (inf.  Mech.  (C0.G-5,  etc)  (Months)  (Country)  (Months) 
Div. ) Armd)  


2.  If  you  have  ever  participated  in  Ai'T,  CPX,  FTX  or  Map  exercises  in  West 
Germany,  please  fill  in  the  following  blanks.  If  you  have  never  partici- 
pated in  these  activities,  continue  to  the  next  question. 


YEAR  UNIT 

(Co,,  Bn..  Div. ) 


POSITION  Type  and 

(Cmdr.  X-0.  Etc.)  Number  of  Exercises 


Education 

3.  Please  indicate  (V)  whether  you  have  attended  any  of  the  following  Army 
Schools.  If  you  have,  please  fill  in  the  supplementary  blanks. 

a)  U.  S.  Army  Command  and  General  Staff  College 

Year  Graduated 

b)  National  War  College  (Ft.  McNair) 

Year  Graduated 

c)  Army  War  College  (Carlisle  Barracks) 

Year  Graduated 


4.  Please  circle  highest  year  completed: 


College  123 
Graduate  123 


k 

k 


Degree__ 

Degree_ 


Field_ 

Field 


Review  of  SIMTOS 

Please  your  response. 

3.  Were  you  satisfied  with  the  way  you 
were  contacted  to  participate  as  a 
consultant? 


YES 


NO 


6.  Before  working  on  the  SIMTOS  t&sk,  you  YES  NO 

participated  in  an  Interview  designed 

to  assess  the  characteristics  of  your 
decision  making  behavior.  The  purpose 
of  the  interview  was  to  provide  the 
information  necessary  to  adapt  decision 
support  systems  to  your  "style" 

Was  the  interview  interesting? 

Please  list  the  scenarios  you  remember. 

Were  ary  of  the  scenarios  particularly 
challenging? 

Would  you  participate  in  such  an  inter- 
view again? 

7.  Although  SIMTOS  is  not  an  operational  tactical  information  system,  the 
knowledge  being  gained  from  its  study  will  serve  as  the  background  for 
the  development  of  future  decision  support  systems. 

With  the  design  of  these  future  systems  in  mind,  how  would  you  rate  STMTOS 
(as  you  used  it  today)  performance,  i.e.,  how  well  did  it  help  you  accomp- 
lish your  mission? 

Fair  1 2 3 4 5 Excellent 

Would  you  agree  or  disagree  with  the  following  statement:  Military 

information  systems  must  be  responsive  to  the  information  requirements 
and  "command  style"  of  the  user. 

Agree  Disagree 

8.  In  which  of  the  following  functions  would  you  prefer  to  use  sn  automated 
system  instead  of  a staff  officer  (please  check  ^ ). 

Intelligence  Gathering 
Troop  Organization 
Logistical  Planning 
Contingency  Planning 
Implementation  of  Orders 
Communication 
Other 

Thank  you  again  for  participating  in  the  evaluation  of  decision  aided  SIMTOS. 
We  would  welcome  any  further  comments  on  these  efforts. 


ACTIONS  PER  CATEGORY/TIMES  CATEGORY  QUERI 
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ACTIONS  PER  CATEGORY/TIMES  CATEGORY  QUERIED 


Number  Redundant 


Number  Redundant  Queries/Total 


DATA/qUERIES 


Hold  Rel. 


Figure  B-35.  Infomution  Acquisition:  Logical /Intuitive 
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PERCENT  ATTRITION 


PERCENT  ATTRITION 


PASSIVE 


Figure  B-37.  Friendly  Force  Attrition:  Actlve/Passlve 
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Figure  B-65.  Enemy  Force  Attrition:  Actlve/Passlve 
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PERCENT  AVAILABLE  (AVERAGE) 
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Figure  B-80.  Weapon  Expenditure  - 8":  Alded/Unalded 
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Figure  B-82.  Weapon  Expenditure  Tac  Air:  Aided/Unaided 


Weapon  Expenditure  - 155  MM;  Logical  (Aided  and  Unaided) 


Expenditure  - 155  MM:  Active  (Aided  and  Unaided) 


Weapon  Expenditure  - 155  MM:  Passive  (Aided  and  Unaided) 
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"92.  Weapon  Expenditure  - 8":  Logical  (Aided  and  Unaided) 


Weapon  Expenditure  - 8":  Active/Passive 


Expenditure  - 8":  Passive  (Aided  and  Unaided) 


Expendlf;ure  - 8":  High  Abstract/Low  Abstract /Concrete 


Expenditure  - HJ:  Logical  (Aided  and  Unaided) 


Expenditure  - HJ:  Intuitive  (Aided  and  Unaided) 


Figure  B^107 . Weapon 


Expenditure 
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Figure  Weapon  Expenditure  - TacAir:  Active  (Aided  and  Unaided) 


Feigure  B-112.  Weapon  Expenditure  - Tac 


Weapon  Expenditure  - Tac  Air:  High  Abstract/Low  Abstract/Concrete 


Weapon  Expenditure 
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Figure  B-U9.  Resource  Allocation  - Firing  Time;  Aided/Unaided 
and  Style  Groups  (Aided/Unaided) 


MEASURES 


PLANNING 


COMBAT 


Information  Processing 


1.  Sources  Sought 

2.  Action  Ratio 

3.  Error  Ratio 

4 . Redundancy  Ratio 

5.  Information  Acquisition  Ratio 

6.  Resource  Allocation  Usage  Efficiency 

7 . Firing  Time 
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Tactical 


1. 

2. 

3. 

4. 

5. 

6. 

7. 


Defensive  Plans 

Friendly  Force  Attrition 

Enemy  Force  Attrition 

Distance  Surrendered 

Friendly  Force  Weapon  Expenditure 

Ei>ents 

Enemy  Force  Objectives  Reached 
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